2020-11-20T10:47:38.160 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T10:47:38.162 DEBUG:teuthology.run:Teuthology command: teuthology --lock --verbose --owner scheduled_pdonnell@teuthology --block --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench} --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209 -- /tmp/teuthology-worker.0tbvfi5f.tmp 2020-11-20T10:47:38.207 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T10:47:38.273 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench} email: pdonnell@redhat.com first_in_suite: false job_id: '5640209' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.6040 2020-11-20T10:47:38.274 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T10:47:38.276 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T10:47:38.276 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T10:47:38.278 INFO:teuthology.task.internal:Checking packages... 2020-11-20T10:47:38.305 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T10:47:38.305 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T10:47:38.306 INFO:teuthology.packaging:ref: None 2020-11-20T10:47:38.306 INFO:teuthology.packaging:tag: None 2020-11-20T10:47:38.306 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T10:47:38.307 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T10:47:38.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T10:47:38.507 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T10:47:38.508 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T10:47:38.518 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T10:47:38.518 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T10:47:38.544 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T10:47:38.545 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T10:47:38.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:47:48.617 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:47:58.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:48:08.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:48:18.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:48:28.687 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:48:38.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:48:48.717 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:48:58.741 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:49:08.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:49:18.783 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:49:28.797 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:49:38.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:49:48.838 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:49:58.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:50:08.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:50:18.902 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:50:28.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:50:38.934 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:50:48.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:50:58.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:51:08.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:51:19.010 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:51:29.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:51:39.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:51:49.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:51:59.087 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:52:09.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:52:19.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:52:29.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:52:39.156 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:52:49.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:52:59.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:53:09.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:53:19.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:53:29.262 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:53:39.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:53:49.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:53:59.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:09.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:19.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:29.365 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:39.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:49.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:54:59.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:55:09.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:55:19.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:55:29.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:55:39.490 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:55:49.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:55:59.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:09.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:19.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:29.581 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:39.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:49.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:56:59.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:09.659 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:19.674 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:29.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:39.726 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:49.744 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:57:59.758 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:58:09.775 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:58:19.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:58:29.809 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:58:39.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T10:58:49.851 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:58:59.867 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:59:09.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:59:19.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T10:59:29.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:59:39.946 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:59:49.964 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T10:59:59.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:00:10.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:00:20.018 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:00:30.037 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:00:40.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:00:50.070 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:01:00.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:01:10.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:01:20.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:01:30.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:01:40.169 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:01:50.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:00.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:10.211 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:20.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:30.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:40.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:02:50.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:00.325 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:10.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:20.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:30.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:40.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:03:50.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:00.447 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:10.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:20.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:30.511 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:40.528 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:04:50.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:00.565 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:10.581 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:20.596 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:30.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:40.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:05:50.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:00.679 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:10.698 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:20.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:06:30.730 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209'} 2020-11-20T11:06:30.752 DEBUG:teuthology.lock.ops:locked ubuntu@smithi112.front.sepia.ceph.com, ubuntu@smithi166.front.sepia.ceph.com, ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:06:30.832 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c541cbea0>, signals=[15]) 2020-11-20T11:06:31.049 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of rhel 8.3 2020-11-20T11:06:31.051 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.3 2020-11-20T11:06:31.053 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of rhel 8.3 2020-11-20T11:06:31.443 INFO:teuthology.orchestra.console:Power off smithi166 2020-11-20T11:06:31.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:06:31.460 INFO:teuthology.orchestra.console:Power off smithi204 2020-11-20T11:06:31.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:06:31.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:31.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:31.497 INFO:teuthology.orchestra.console:Power off smithi112 2020-11-20T11:06:31.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:06:31.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:35.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:35.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:35.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:39.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:39.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:39.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:43.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:43.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:43.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:43.944 INFO:teuthology.orchestra.console:Power off for smithi166 completed 2020-11-20T11:06:43.952 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2020-11-20T11:06:43.976 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2020-11-20T11:06:44.045 INFO:teuthology.orchestra.console:Power on smithi166 2020-11-20T11:06:44.046 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:06:44.055 INFO:teuthology.orchestra.console:Power on smithi204 2020-11-20T11:06:44.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:06:44.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:44.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:44.082 INFO:teuthology.orchestra.console:Power on smithi112 2020-11-20T11:06:44.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:06:44.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:48.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:48.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:48.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:48.312 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2020-11-20T11:06:48.339 INFO:teuthology.orchestra.console:Power on for smithi112 completed 2020-11-20T11:06:48.412 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2020-11-20T11:06:48.440 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2020-11-20T11:06:52.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:06:52.417 INFO:teuthology.orchestra.console:Power on for smithi166 completed 2020-11-20T11:06:52.518 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish 2020-11-20T11:09:19.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:23.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:28.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:32.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:34.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:37.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:41.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:43.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:46.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:50.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:52.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:56.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:09:59.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:02.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:05.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:09.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:11.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:14.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:18.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:20.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:29.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:42.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:51.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:10:51.976 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:10:51.978 INFO:teuthology.orchestra.run.smithi166:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:11:12.540 INFO:teuthology.provision.fog.smithi166:Node is ready 2020-11-20T11:11:12.541 INFO:teuthology.orchestra.run.smithi166:> hostname 2020-11-20T11:11:12.559 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com 2020-11-20T11:11:12.560 INFO:teuthology.orchestra.run.smithi166:> grep smithi166.front.sepia.ceph.com /etc/hosts 2020-11-20T11:11:12.616 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166 2020-11-20T11:11:12.616 INFO:teuthology.orchestra.run.smithi166:> sudo hostname smithi166 2020-11-20T11:11:12.754 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/smithi166.front.sepia.ceph.com/smithi166/g' /etc/hosts 2020-11-20T11:11:12.781 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/172.21.15.166/172.21.15.166/g' /etc/hosts 2020-11-20T11:11:12.847 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/smithi166.front.sepia.ceph.com/smithi166/g' /etc/hostname 2020-11-20T11:11:12.912 INFO:teuthology.orchestra.run.smithi166:> sudo hostname smithi166 2020-11-20T11:11:12.976 INFO:teuthology.provision.fog.smithi166:Deploy complete! 2020-11-20T11:11:12.978 DEBUG:teuthology.parallel:result is None 2020-11-20T11:11:20.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:20.433 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:11:20.433 INFO:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:11:20.730 INFO:teuthology.provision.fog.smithi112:Node is ready 2020-11-20T11:11:20.731 INFO:teuthology.orchestra.run.smithi112:> hostname 2020-11-20T11:11:20.745 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2020-11-20T11:11:20.745 INFO:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2020-11-20T11:11:20.799 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2020-11-20T11:11:20.800 INFO:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2020-11-20T11:11:20.903 INFO:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2020-11-20T11:11:20.928 INFO:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2020-11-20T11:11:20.991 INFO:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2020-11-20T11:11:21.054 INFO:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2020-11-20T11:11:21.116 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2020-11-20T11:11:21.117 DEBUG:teuthology.parallel:result is None 2020-11-20T11:11:35.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:35.474 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:11:35.475 INFO:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:11:35.771 INFO:teuthology.provision.fog.smithi204:Node is ready 2020-11-20T11:11:35.771 INFO:teuthology.orchestra.run.smithi204:> hostname 2020-11-20T11:11:35.785 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2020-11-20T11:11:35.786 INFO:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2020-11-20T11:11:35.840 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2020-11-20T11:11:35.841 INFO:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2020-11-20T11:11:35.953 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2020-11-20T11:11:35.983 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2020-11-20T11:11:36.065 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2020-11-20T11:11:36.143 INFO:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2020-11-20T11:11:36.217 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2020-11-20T11:11:36.217 DEBUG:teuthology.parallel:result is None 2020-11-20T11:11:36.427 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2020-11-20T11:11:36.428 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:11:36.446 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com 2020-11-20T11:11:36.447 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:11:36.460 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2020-11-20T11:11:36.461 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:11:36.477 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:11:36.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:11:36.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:36.545 INFO:teuthology.orchestra.run.smithi112:> true 2020-11-20T11:11:36.711 INFO:teuthology.orchestra.run.smithi112:> uname -m 2020-11-20T11:11:36.765 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2020-11-20T11:11:36.765 INFO:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2020-11-20T11:11:36.818 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:36.819 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:36.819 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2020-11-20T11:11:36.819 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2020-11-20T11:11:36.819 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.3" 2020-11-20T11:11:36.820 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:36.820 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:36.820 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:36.820 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:36.820 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:36.821 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:36.821 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:36.821 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:36.821 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:36.821 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:36.822 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:36.823 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2020-11-20T11:11:36.838 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:11:36.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:11:36.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:36.910 INFO:teuthology.orchestra.run.smithi166:> true 2020-11-20T11:11:37.079 INFO:teuthology.orchestra.run.smithi166:> uname -m 2020-11-20T11:11:37.134 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2020-11-20T11:11:37.134 INFO:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2020-11-20T11:11:37.188 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:37.189 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:37.189 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel" 2020-11-20T11:11:37.190 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora" 2020-11-20T11:11:37.190 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.3" 2020-11-20T11:11:37.190 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:37.190 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:37.190 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:37.191 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:37.191 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:37.191 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:37.191 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:11:37.191 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:37.192 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:37.192 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:37.192 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:37.192 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2020-11-20T11:11:37.210 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:11:37.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:11:37.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:37.280 INFO:teuthology.orchestra.run.smithi204:> true 2020-11-20T11:11:37.451 INFO:teuthology.orchestra.run.smithi204:> uname -m 2020-11-20T11:11:37.505 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2020-11-20T11:11:37.506 INFO:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2020-11-20T11:11:37.559 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:37.559 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:37.559 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2020-11-20T11:11:37.560 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2020-11-20T11:11:37.560 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.3" 2020-11-20T11:11:37.560 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:37.560 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:37.561 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:37.561 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:37.561 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:37.561 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:37.561 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:11:37.562 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:37.562 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:37.562 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:37.562 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:37.563 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2020-11-20T11:11:37.579 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T11:11:37.843 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRe8BvPiGkqMhsyU0T+xryfH62+QXI/VYa2uYoox2OXfDH6Q9ebQqZ0YNQeVh0mRspHAze4SVD6GMb6UpbOWPxrQDqh3BO80Bsg/YbdYe1nAoXJIoYPVZ7hTy1YJl4ovftbVENTZGLE+36D05N4+H+9paz3nqAHRu/U+h+u77YE+LJ2xH0hOO02Ov4bVfmGkaVO5Ay/LKcyllSvDr03MFPSdBN67hbR64a+rAAgpk4Q5/0msuTAZfFZJtTSINPj8AHnO2ORf9qe9HnNkGeJB+2369JCD1X3IvIMh8EFtBDsRJtKim65dZSs2MJy+jBbWt8PsdLfD8FQfQQROsTfQMY9hFaD6AiTe8gERmoU74v+EUVimvRZ8fGSNsfRFP1cDB/FiZ4o/1ZqoBY/L7Dm3XLYX4FCSRkh409gQen15tUcV2fdWTBOu8GV7kOdINzp3UexElLSC2Tfs/Pqt9dB4DnCHwFWyiHhLJX2Dn3H6vnMPTW8JuxlRSvqc2zhvz9Tis= smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtfZhUIbZXPfjpfyjjxQvL0IIgRz3Y2nEkY7N+DiwEDQ0zNk+gu80ej0O24lfLrbdiAcTpjfPDSzIVcPHpLXce7diiXfiRWygIXE6prtEStj5+WPlWceJyr+fn3Es1s2SoHiIJuZcwzFI0qDDLWUFxrr8KX3LfuSx89UQd0sow9eUSDUghS/pQDgtFUATAXalGxiSCqSsHL11WTm6L6vMurjXm98WIv8oRjVn1HimIYUgC8gMbD+EHhcLXDSMcd97g2KCkH5zeThQPcGRt0wiBYX/G2mJ1jSFbDh82EYz0HR7nLZgCSnZfVAiD2m25ehmMoYpoasd9RVS0lPV9M6dNOAWLQQIoiNHKc9bGO7+aJUR6l71RI38maypP0dMg3IHFU2JE8r/BT13N9YGeDzjKCFO8N0DNkrJ+IRzL6hJBI3TPVnNbr6l9EkvGM1afrlns0sgULjKZOv4tKVis3aUXn+Ay80I8oDv0SId6KTHC+RKTAEaHytaXz12vcwXiEyc= smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0Id0dUhAWfhF2dpWSMnVRvPzH9VtSLhC4VA8nc2ApMc/pPbSlcW7CQxIwbdBNvvk1RMQZgEZysEyct8Fb5Mo6iLSuFo1lVnmLiY/X5fNlRkjTpJRg3BrZ+IFbBUflYnJOzml1cvXtexaLJaXy5fJhZO4Wpv8+Z8fRIbyeebcfFFaAlryUD4JSVmqrAol8gjYxoe/MAcx0GPvUriceJ0PuPYZvAsV0TTfpak7CP16z+3CPVs/R3f4sQjaAo2TZIQ/2B1aRRiWTJ/OMfSOmRqfd+QxMMVU5VgwttZMHKRhdsML675oUJps7Q5G8Kzk3s1f1m6xcw5aTp4HgY3zoe5vuS/aUxHVgl8gNVTyBDbUGtUdlWC6AZ1zP6uqN0ShFXHONmv/8MjhA5YG2yChdZMs8/jO1iw7gZTwe8EXd5/db3bR8XgSmRe5hX3H3yuQPlj60s8RUAVb6OgVCZaTEKQZMpOPYtTW26bJuB3O43aI2M14OR8I6Z43OxM/LdfzrV2k= 2020-11-20T11:11:37.844 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:11:37.907 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T11:11:37.917 INFO:teuthology.task.internal:Saving configuration 2020-11-20T11:11:37.937 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T11:11:37.947 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T11:11:37.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:06:30.737096', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZMW81KrEll2HSsNGaw2P3IQ7ZZBjpstMFSLqN+9YX5u2ricAKMV5mSvc7NrsKgiek2FoqflJSwkSsDGpcXhRg=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi112.front.sepia.ceph.com'} 2020-11-20T11:11:37.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:06:30.737117', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNj2b/CQu2sizzNWmOW2CD0h/fe2k6wORhFwEwT/oomBxz3OupW+b3bbeBJ+zGD97d6P/MVy4rR3E0RbawoQ6bA=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi166.front.sepia.ceph.com'} 2020-11-20T11:11:37.998 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:06:30.737133', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLjCP8w1G8VHdPzu8N1vxLWAdz2qPgQQuq8j9Be+RkQMo/LAYXrIbfmto2bkcuRcnPlm+iGgBoyqYroF85ty7xo=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi204.front.sepia.ceph.com'} 2020-11-20T11:11:37.998 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T11:11:38.009 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T11:11:38.009 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T11:11:38.009 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T11:11:38.010 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T11:11:38.130 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c54213d08>, signals=[15]) 2020-11-20T11:11:38.131 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T11:11:38.156 INFO:teuthology.task.internal:Opening connections... 2020-11-20T11:11:38.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:11:38.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:38.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:11:38.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:38.387 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:11:38.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:11:38.468 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T11:11:38.483 INFO:teuthology.orchestra.run.smithi112:> uname -m 2020-11-20T11:11:38.500 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2020-11-20T11:11:38.500 INFO:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2020-11-20T11:11:38.554 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:38.554 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:38.555 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2020-11-20T11:11:38.555 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2020-11-20T11:11:38.555 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.3" 2020-11-20T11:11:38.555 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:38.556 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:38.556 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:38.556 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:38.556 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:38.557 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:38.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:38.557 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:38.557 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:38.557 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:38.558 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:38.558 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2020-11-20T11:11:38.576 INFO:teuthology.orchestra.run.smithi166:> uname -m 2020-11-20T11:11:38.591 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2020-11-20T11:11:38.592 INFO:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2020-11-20T11:11:38.645 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:38.646 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:38.646 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel" 2020-11-20T11:11:38.646 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora" 2020-11-20T11:11:38.646 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.3" 2020-11-20T11:11:38.647 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:38.647 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:38.647 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:38.647 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:38.647 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:38.648 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:38.648 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:11:38.648 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:38.648 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:38.649 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:38.649 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:38.649 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2020-11-20T11:11:38.668 INFO:teuthology.orchestra.run.smithi204:> uname -m 2020-11-20T11:11:38.683 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2020-11-20T11:11:38.684 INFO:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2020-11-20T11:11:38.737 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:11:38.738 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:11:38.738 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2020-11-20T11:11:38.738 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2020-11-20T11:11:38.738 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.3" 2020-11-20T11:11:38.738 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:11:38.739 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:11:38.739 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2020-11-20T11:11:38.739 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:11:38.739 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:11:38.739 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:11:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:11:38.740 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:11:38.740 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:11:38.741 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:11:38.741 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:11:38.742 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2020-11-20T11:11:38.759 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T11:11:38.787 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T11:11:38.796 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T11:11:38.797 INFO:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:11:38.800 INFO:teuthology.orchestra.run.smithi166:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:11:38.802 INFO:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:11:38.817 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T11:11:38.826 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T11:11:38.827 INFO:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:11:38.853 INFO:teuthology.orchestra.run.smithi166:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:11:38.856 INFO:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:11:38.876 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T11:11:38.936 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T11:11:38.950 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'sha1': 'distro'}} 2020-11-20T11:11:38.951 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2020-11-20T11:11:38.951 INFO:teuthology.orchestra.run.smithi112:> uname -r 2020-11-20T11:11:38.966 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:11:38.966 INFO:teuthology.task.kernel:Running kernel on smithi112: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:11:38.967 INFO:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2020-11-20T11:11:40.460 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2020-11-20T11:11:40.463 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2020-11-20T11:11:40.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:40.588 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:11:40.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:42.329 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 25 MB/s | 8.3 MB 00:00 2020-11-20T11:11:43.985 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 5.3 MB/s | 23 kB 00:00 2020-11-20T11:11:44.033 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:11:43 AM UTC. 2020-11-20T11:11:44.535 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T11:11:44.536 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T11:11:44.648 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2020-11-20T11:11:44.659 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2020-11-20T11:11:44.659 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2020-11-20T11:11:44.791 INFO:teuthology.orchestra.run.smithi112:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:11:45.054 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2020-11-20T11:11:45.054 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2020-11-20T11:11:45.095 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:45.096 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:11:45.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:45.262 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:11:43 AM UTC. 2020-11-20T11:11:45.383 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:11:45.384 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:11:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2020-11-20T11:11:45.465 INFO:teuthology.orchestra.run.smithi112:> sudo yum reinstall -y kernel || true 2020-11-20T11:11:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2020-11-20T11:11:45.726 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2020-11-20T11:11:45.778 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:45.779 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:11:45.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:11:45.942 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:11:43 AM UTC. 2020-11-20T11:11:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:11:46.074 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:11:46.109 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2020-11-20T11:11:46.148 INFO:teuthology.orchestra.run.smithi112:> rpm -q kernel --last | head -n 1 2020-11-20T11:11:46.237 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T11:11:46.238 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:11:46.238 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:11:46.239 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T11:11:46.250 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T11:11:46.250 INFO:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:11:46.253 INFO:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:11:46.256 INFO:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:11:46.274 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T11:11:46.317 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T11:11:46.331 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T11:11:46.331 INFO:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:11:46.334 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:11:46.338 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:11:46.359 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T11:11:46.370 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T11:11:46.370 INFO:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:11:46.395 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:11:46.402 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:11:46.420 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.434 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.440 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.441 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.457 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.458 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:11:46.459 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T11:11:46.470 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T11:11:46.470 INFO:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:11:46.477 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:11:46.502 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:11:46.530 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T11:11:46.545 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T11:11:46.546 INFO:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:11:46.549 INFO:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:11:46.569 INFO:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:11:46.585 INFO:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:46.634 INFO:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:46.692 INFO:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:46.765 INFO:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:46.812 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:11:46.813 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:46.865 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:46.873 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:11:46.874 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:11:46.874 INFO:teuthology.orchestra.run.smithi112.stderr:152 bytes copied, 2.5271e-05 s, 6.0 MB/s 2020-11-20T11:11:46.875 INFO:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:46.910 INFO:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:46.996 INFO:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:47.031 INFO:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:47.078 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:11:47.079 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:47.132 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:47.142 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:11:47.142 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:11:47.142 INFO:teuthology.orchestra.run.smithi166.stderr:152 bytes copied, 3.0239e-05 s, 5.0 MB/s 2020-11-20T11:11:47.143 INFO:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:47.180 INFO:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:11:47.270 INFO:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:47.310 INFO:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:11:47.361 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:11:47.362 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:47.423 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:11:47.433 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:11:47.435 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:11:47.435 INFO:teuthology.orchestra.run.smithi204.stderr:152 bytes copied, 2.9015e-05 s, 5.2 MB/s 2020-11-20T11:11:47.438 INFO:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2020-11-20T11:11:47.445 INFO:teuthology.orchestra.run.smithi166:> sudo service rsyslog restart 2020-11-20T11:11:47.451 INFO:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2020-11-20T11:11:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:11:47.516 INFO:teuthology.orchestra.run.smithi166.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:11:47.529 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:11:47.982 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T11:11:47.996 INFO:teuthology.task.internal:Starting timer... 2020-11-20T11:11:47.996 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T11:11:48.066 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T11:11:48.080 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T11:11:48.080 INFO:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2020-11-20T11:11:48.145 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: [ OK ] 2020-11-20T11:11:48.146 INFO:teuthology.orchestra.run.smithi166:> sudo service auditd rotate 2020-11-20T11:11:48.217 INFO:teuthology.orchestra.run.smithi166.stdout:Rotating logs: [ OK ] 2020-11-20T11:11:48.219 INFO:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2020-11-20T11:11:48.318 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: [ OK ] 2020-11-20T11:11:48.319 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T11:11:48.320 INFO:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2020-11-20T11:11:48.353 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2020-11-20T11:11:48.353 INFO:teuthology.orchestra.run.smithi166:> /usr/sbin/getenforce 2020-11-20T11:11:48.378 INFO:teuthology.orchestra.run.smithi166.stdout:Permissive 2020-11-20T11:11:48.379 INFO:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2020-11-20T11:11:48.398 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2020-11-20T11:11:48.399 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi166.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2020-11-20T11:11:48.399 INFO:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:11:48.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:11:48.424 INFO:teuthology.orchestra.run.smithi166:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:11:48.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:11:48.452 INFO:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:11:48.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:11:48.478 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T11:11:48.479 INFO:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:11:48.503 INFO:teuthology.orchestra.run.smithi166:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:11:48.539 INFO:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:11:48.564 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T11:11:48.578 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-11-20T11:11:48.583 INFO:teuthology.repo_utils:Fetching master from origin 2020-11-20T11:11:48.630 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T11:11:48.642 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T11:11:48.643 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi166.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T11:11:48.994 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T11:11:49.920 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T11:11:52.541 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T11:11:52.566 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:52 +0000 (0:00:00.093) 0:00:00.093 ******* 2020-11-20T11:11:52.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:52 +0000 (0:00:00.015) 0:00:00.108 ******* 2020-11-20T11:11:52.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:52 +0000 (0:00:00.017) 0:00:00.125 ******* 2020-11-20T11:11:53.989 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-20T11:11:53.991 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] 2020-11-20T11:11:54.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:01.461) 0:00:01.587 ******* 2020-11-20T11:11:54.111 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] 2020-11-20T11:11:54.154 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2020-11-20T11:11:54.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.150) 0:00:01.737 ******* 2020-11-20T11:11:54.252 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.040) 0:00:01.778 ******* 2020-11-20T11:11:54.362 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T11:11:54.364 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:11:54.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.144) 0:00:01.922 ******* 2020-11-20T11:11:54.403 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:11:54.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.040) 0:00:01.963 ******* 2020-11-20T11:11:54.443 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:11:54.477 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.040) 0:00:02.003 ******* 2020-11-20T11:11:54.763 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T11:11:54.764 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:11:54.765 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:11:54.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.320) 0:00:02.324 ******* 2020-11-20T11:11:54.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.029) 0:00:02.353 ******* 2020-11-20T11:11:54.832 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:11:54.833 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T11:11:54.833 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:54.866 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.039) 0:00:02.393 ******* 2020-11-20T11:11:54.895 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.028) 0:00:02.421 ******* 2020-11-20T11:11:54.900 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:54.902 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:54.934 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.039) 0:00:02.461 ******* 2020-11-20T11:11:54.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:54 +0000 (0:00:00.029) 0:00:02.490 ******* 2020-11-20T11:11:55.222 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T11:11:55.224 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:11:55.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:55 +0000 (0:00:00.298) 0:00:02.788 ******* 2020-11-20T11:11:55.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:55 +0000 (0:00:00.029) 0:00:02.818 ******* 2020-11-20T11:11:55.323 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:55 +0000 (0:00:00.030) 0:00:02.848 ******* 2020-11-20T11:11:56.124 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T11:11:56.127 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870715.30745-8956476203630/source", "state": "file", "uid": 0} changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870715.3349795-280709058829756/source", "state": "file", "uid": 0} 2020-11-20T11:11:56.167 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:56 +0000 (0:00:00.845) 0:00:03.693 ******* 2020-11-20T11:11:56.203 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:56 +0000 (0:00:00.036) 0:00:03.729 ******* 2020-11-20T11:11:56.213 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870715.2747078-116426921534502/source", "state": "file", "uid": 0} 2020-11-20T11:11:56.244 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:56 +0000 (0:00:00.040) 0:00:03.770 ******* 2020-11-20T11:11:56.671 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T11:11:56.672 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:11:56.674 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:11:56.707 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:11:56.708 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:11:56.760 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:11:56.761 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:11:56.869 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T11:11:56.877 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T11:11:57.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.785) 0:00:04.556 ******* 2020-11-20T11:11:57.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.030) 0:00:04.586 ******* 2020-11-20T11:11:57.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.030) 0:00:04.617 ******* 2020-11-20T11:11:57.642 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi112.front.sepia.ceph.com] 2020-11-20T11:11:57.691 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2020-11-20T11:11:57.732 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T11:11:57.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.641) 0:00:05.259 ******* 2020-11-20T11:11:57.765 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] 2020-11-20T11:11:57.806 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.073) 0:00:05.333 ******* 2020-11-20T11:11:57.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:57 +0000 (0:00:00.065) 0:00:05.398 ******* 2020-11-20T11:11:58.181 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T11:11:58.183 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.154700", "end": "2020-11-20 11:11:58.155429", "rc": 0, "start": "2020-11-20 11:11:58.000729", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} changed: [smithi112.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.163572", "end": "2020-11-20 11:11:58.160991", "rc": 0, "start": "2020-11-20 11:11:57.997419", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:11:58.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.344) 0:00:05.743 ******* 2020-11-20T11:11:58.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.029) 0:00:05.773 ******* 2020-11-20T11:11:58.254 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.168768", "end": "2020-11-20 11:11:58.191659", "rc": 0, "start": "2020-11-20 11:11:58.022891", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:11:58.288 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.041) 0:00:05.815 ******* 2020-11-20T11:11:58.398 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:11:58.400 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007082", "end": "2020-11-20 11:11:58.377071", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:11:58.369989", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:11:58.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.145) 0:00:05.960 ******* 2020-11-20T11:11:58.441 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011352", "end": "2020-11-20 11:11:58.415480", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:11:58.404128", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:11:58.476 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.042) 0:00:06.003 ******* 2020-11-20T11:11:58.483 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:11:58.484 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:11:58.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.040) 0:00:06.044 ******* 2020-11-20T11:11:58.523 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:11:58.525 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013968", "end": "2020-11-20 11:11:58.458189", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:11:58.444221", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:11:58.557 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.039) 0:00:06.083 ******* 2020-11-20T11:11:58.587 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.029) 0:00:06.113 ******* 2020-11-20T11:11:58.592 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:11:58.593 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.627 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.039) 0:00:06.153 ******* 2020-11-20T11:11:58.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.031) 0:00:06.185 ******* 2020-11-20T11:11:58.664 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:11:58.666 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.038) 0:00:06.224 ******* 2020-11-20T11:11:58.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.030) 0:00:06.255 ******* 2020-11-20T11:11:58.734 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.735 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.039) 0:00:06.294 ******* 2020-11-20T11:11:58.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.030) 0:00:06.324 ******* 2020-11-20T11:11:58.803 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:11:58.805 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.838 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.039) 0:00:06.364 ******* 2020-11-20T11:11:58.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.030) 0:00:06.394 ******* 2020-11-20T11:11:58.872 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T11:11:58.874 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.040) 0:00:06.434 ******* 2020-11-20T11:11:58.938 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.030) 0:00:06.465 ******* 2020-11-20T11:11:58.944 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:11:58.946 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.980 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:58 +0000 (0:00:00.041) 0:00:06.506 ******* 2020-11-20T11:11:58.986 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:11:58.988 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.988 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.990 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:58.990 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45 2020-11-20T11:11:58.992 INFO:teuthology.task.ansible.out:b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.025 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.045) 0:00:06.551 ******* 2020-11-20T11:11:59.032 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.033 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T11:11:59.033 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.033 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:11:59.034 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.034 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.036 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.036 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B93 2020-11-20T11:11:59.038 INFO:teuthology.task.ansible.out:5dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7Y 2020-11-20T11:11:59.040 INFO:teuthology.task.ansible.out:yYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.046) 0:00:06.598 ******* 2020-11-20T11:11:59.077 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.078 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.080 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.081 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.082 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.083 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.046) 0:00:06.644 ******* 2020-11-20T11:11:59.124 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.126 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:11:59.126 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.127 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.128 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.129 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxiche 2020-11-20T11:11:59.130 INFO:teuthology.task.ansible.out:n", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.046) 0:00:06.690 ******* 2020-11-20T11:11:59.171 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.173 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.173 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.174 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.175 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewsc 2020-11-20T11:11:59.176 INFO:teuthology.task.ansible.out:hoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745e 2020-11-20T11:11:59.178 INFO:teuthology.task.ansible.out:d46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.188 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.190 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa2 2020-11-20T11:11:59.192 INFO:teuthology.task.ansible.out:56fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.072) 0:00:06.763 ******* 2020-11-20T11:11:59.244 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.245 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.246 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.248 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.248 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c0 2020-11-20T11:11:59.250 INFO:teuthology.task.ansible.out:4c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d2 2020-11-20T11:11:59.252 INFO:teuthology.task.ansible.out:7cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C 2020-11-20T11:11:59.253 INFO:teuthology.task.ansible.out:7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHn 2020-11-20T11:11:59.255 INFO:teuthology.task.ansible.out:wg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.265 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.267 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.267 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@Lo 2020-11-20T11:11:59.269 INFO:teuthology.task.ansible.out:calSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.269 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1ht 2020-11-20T11:11:59.271 INFO:teuthology.task.ansible.out:p39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.281 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.282 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.283 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.284 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.285 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false 2020-11-20T11:11:59.287 INFO:teuthology.task.ansible.out:, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.297 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.298 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.299 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.300 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@ 2020-11-20T11:11:59.302 INFO:teuthology.task.ansible.out:mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.303 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.314 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.315 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.316 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372 2020-11-20T11:11:59.317 INFO:teuthology.task.ansible.out:ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.318 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a2553 2020-11-20T11:11:59.320 INFO:teuthology.task.ansible.out:27d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.331 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.333 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.344 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.345 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.347 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.357 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.359 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.359 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.361 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.362 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.363 INFO:teuthology.task.ansible.out: 2020-11-20T11:11:59.374 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.377 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.379 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.379 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.381 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.381 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.394 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.396 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.397 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsY 2020-11-20T11:11:59.399 INFO:teuthology.task.ansible.out:qKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.400 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624ca 2020-11-20T11:11:59.402 INFO:teuthology.task.ansible.out:df255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was Fa 2020-11-20T11:11:59.404 INFO:teuthology.task.ansible.out:lse"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.414 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.415 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a 2020-11-20T11:11:59.417 INFO:teuthology.task.ansible.out:9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.429 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika 2020-11-20T11:11:59.431 INFO:teuthology.task.ansible.out:@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.442 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.444 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.445 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.447 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.447 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.449 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.450 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.451 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.451 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf2 2020-11-20T11:11:59.453 INFO:teuthology.task.ansible.out:22e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.464 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.465 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.467 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.469 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.469 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.470 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.471 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.473 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.474 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.486 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.488 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.499 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.500 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.501 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPt 2020-11-20T11:11:59.502 INFO:teuthology.task.ansible.out:ggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.512 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.513 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.514 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.514 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUD 2020-11-20T11:11:59.516 INFO:teuthology.task.ansible.out:VmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.525 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.527 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.529 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.531 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.531 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iP 2020-11-20T11:11:59.533 INFO:teuthology.task.ansible.out:PDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.543 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.544 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.555 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.556 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.558 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.570 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.572 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.582 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.584 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.585 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) 2020-11-20T11:11:59.587 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8e 2020-11-20T11:11:59.589 INFO:teuthology.task.ansible.out:db80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.597 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.599 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora Ofp 2020-11-20T11:11:59.601 INFO:teuthology.task.ansible.out:UShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.611 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.613 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.624 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.625 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.626 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.627 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.628 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.628 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.630 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.630 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.631 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.632 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.633 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.644 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.646 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional 2020-11-20T11:11:59.648 INFO:teuthology.task.ansible.out:result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.649 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) 2020-11-20T11:11:59.651 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2" 2020-11-20T11:11:59.652 INFO:teuthology.task.ansible.out:}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.662 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.664 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ce 2020-11-20T11:11:59.665 INFO:teuthology.task.ansible.out:ph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.676 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.678 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.678 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.690 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.692 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.694 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.695 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.715 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.717 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.718 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 2020-11-20T11:11:59.719 INFO:teuthology.task.ansible.out:hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.720 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.720 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694 2020-11-20T11:11:59.722 INFO:teuthology.task.ansible.out:f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.523) 0:00:07.286 ******* 2020-11-20T11:11:59.768 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.771 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.773 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "s 2020-11-20T11:11:59.775 INFO:teuthology.task.ansible.out:carvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.776 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.776 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.777 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.779 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.779 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.779 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.780 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5 2020-11-20T11:11:59.781 INFO:teuthology.task.ansible.out:301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.782 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.783 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffd 2020-11-20T11:11:59.784 INFO:teuthology.task.ansible.out:bd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.786 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.065) 0:00:07.351 ******* 2020-11-20T11:11:59.832 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.833 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.835 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.835 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.836 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.837 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.837 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.838 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.838 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": 2020-11-20T11:11:59.840 INFO:teuthology.task.ansible.out:"item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.840 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"n 2020-11-20T11:11:59.842 INFO:teuthology.task.ansible.out:ame": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.842 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.843 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.c 2020-11-20T11:11:59.844 INFO:teuthology.task.ansible.out:om] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.855 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.857 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "ite 2020-11-20T11:11:59.859 INFO:teuthology.task.ansible.out:m": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.900 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.075) 0:00:07.426 ******* 2020-11-20T11:11:59.907 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.908 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.909 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.911 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.911 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.912 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.912 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARv 2020-11-20T11:11:59.914 INFO:teuthology.task.ansible.out:QUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.914 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.915 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2020-11-20T11:11:59.916 INFO:teuthology.task.ansible.out:2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.917 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c365 2020-11-20T11:11:59.919 INFO:teuthology.task.ansible.out:94585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9 2020-11-20T11:11:59.920 INFO:teuthology.task.ansible.out:d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.931 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.933 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.935 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.935 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.936 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.936 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.936 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"an 2020-11-20T11:11:59.938 INFO:teuthology.task.ansible.out:sible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:11:59 +0000 (0:00:00.072) 0:00:07.499 ******* 2020-11-20T11:11:59.979 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:11:59.980 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.000 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.001 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.002 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.002 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thi 2020-11-20T11:12:00.004 INFO:teuthology.task.ansible.out:nkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.004 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.005 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:12:00.005 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vik 2020-11-20T11:12:00.006 INFO:teuthology.task.ansible.out:hyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.067) 0:00:07.566 ******* 2020-11-20T11:12:00.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.031) 0:00:07.597 ******* 2020-11-20T11:12:00.079 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.080 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.081 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.082 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.083 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.084 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:12:00.085 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.085 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:12:00.085 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.086 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808 2020-11-20T11:12:00.088 INFO:teuthology.task.ansible.out:728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.050) 0:00:07.648 ******* 2020-11-20T11:12:00.127 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:12:00.129 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.129 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.146 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.179 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.057) 0:00:07.706 ******* 2020-11-20T11:12:00.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.030) 0:00:07.737 ******* 2020-11-20T11:12:00.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.031) 0:00:07.768 ******* 2020-11-20T11:12:00.248 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:12:00.249 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.250 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.250 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.251 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.251 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.251 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.252 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.050) 0:00:07.819 ******* 2020-11-20T11:12:00.299 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.301 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.301 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:12:00.301 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:12:00.302 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.302 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.303 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.303 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.304 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.045) 0:00:07.865 ******* 2020-11-20T11:12:00.345 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.346 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.348 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.348 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.348 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:12:00.349 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.349 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.351 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.351 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.352 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.352 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.352 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.050) 0:00:07.915 ******* 2020-11-20T11:12:00.395 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.395 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T11:12:00.396 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.397 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.398 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.398 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.400 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.050) 0:00:07.965 ******* 2020-11-20T11:12:00.444 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.446 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.446 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.447 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.447 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.449 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.048) 0:00:08.013 ******* 2020-11-20T11:12:00.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.031) 0:00:08.045 ******* 2020-11-20T11:12:00.524 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:12:00.526 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.041) 0:00:08.087 ******* 2020-11-20T11:12:00.566 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:12:00.568 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.601 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.040) 0:00:08.127 ******* 2020-11-20T11:12:00.607 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T11:12:00.608 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.040) 0:00:08.168 ******* 2020-11-20T11:12:00.647 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:12:00.649 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.682 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.040) 0:00:08.209 ******* 2020-11-20T11:12:00.688 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:12:00.690 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.043) 0:00:08.252 ******* 2020-11-20T11:12:00.731 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:12:00.733 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.733 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.744 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.746 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:00 +0000 (0:00:00.054) 0:00:08.307 ******* 2020-11-20T11:12:00.836 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi166.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "ic 2020-11-20T11:12:00.838 INFO:teuthology.task.ansible.out:olle", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.840 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.840 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.840 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.851 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.853 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.854 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.864 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.865 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.867 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.867 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.878 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.880 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.880 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.891 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.893 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.903 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.905 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.906 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.918 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.920 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.921 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.942 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.944 INFO:teuthology.task.ansible.out: skipping: [smithi166.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.946 INFO:teuthology.task.ansible.out: skipping: [smithi166.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.948 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.949 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.953 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.963 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.965 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.976 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.977 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.978 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.995 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.997 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:00.998 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.256) 0:00:08.563 ******* 2020-11-20T11:12:01.045 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.046 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.049 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.049 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.050 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.051 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.053 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.054 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.055 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.056 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.057 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.059 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.062) 0:00:08.625 ******* 2020-11-20T11:12:01.255 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:12:01.257 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:12:01.308 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.209) 0:00:08.834 ******* 2020-11-20T11:12:01.335 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:12:01.336 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => { "msg": "Host smithi112.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:12:01.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.061) 0:00:08.895 ******* 2020-11-20T11:12:01.409 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:12:01.410 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:12:01.450 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.080) 0:00:08.976 ******* 2020-11-20T11:12:01.479 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:12:01.480 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.067) 0:00:09.044 ******* 2020-11-20T11:12:01.526 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:12:01.527 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:12:01.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.044) 0:00:09.089 ******* 2020-11-20T11:12:01.570 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:12:01.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.041) 0:00:09.131 ******* 2020-11-20T11:12:01.611 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:12:01.613 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => { "msg": "Host smithi166.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:12:01.646 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.041) 0:00:09.173 ******* 2020-11-20T11:12:01.653 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => { "msg": "Host smithi204.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:12:01.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.045) 0:00:09.218 ******* 2020-11-20T11:12:01.697 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:12:01.699 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:12:01.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.041) 0:00:09.259 ******* 2020-11-20T11:12:01.739 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:12:01.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.040) 0:00:09.300 ******* 2020-11-20T11:12:01.779 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:12:01.781 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.814 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.039) 0:00:09.340 ******* 2020-11-20T11:12:01.819 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:01.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:01 +0000 (0:00:00.039) 0:00:09.380 ******* 2020-11-20T11:12:01.994 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:12:01.996 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.297936", "end": "2020-11-20 11:12:01.974809", "rc": 0, "start": "2020-11-20 11:12:01.676873", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:12:02.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.174) 0:00:09.555 ******* 2020-11-20T11:12:02.055 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:12:02.057 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.088 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.060) 0:00:09.615 ******* 2020-11-20T11:12:02.116 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:12:02.118 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.149 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.060) 0:00:09.676 ******* 2020-11-20T11:12:02.175 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:12:02.177 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.209 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.059) 0:00:09.736 ******* 2020-11-20T11:12:02.246 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:12:02.247 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.074) 0:00:09.810 ******* 2020-11-20T11:12:02.310 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:12:02.312 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.063) 0:00:09.873 ******* TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.345558", "end": "2020-11-20 11:12:02.316099", "rc": 0, "start": "2020-11-20 11:12:01.970541", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.312242", "end": "2020-11-20 11:12:02.325508", "rc": 0, "start": "2020-11-20 11:12:02.013266", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:12:02.398 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.051) 0:00:09.925 ******* 2020-11-20T11:12:02.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.040) 0:00:09.965 ******* 2020-11-20T11:12:02.445 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:12:02.448 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.049) 0:00:10.015 ******* 2020-11-20T11:12:02.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.041) 0:00:10.057 ******* 2020-11-20T11:12:02.537 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.048) 0:00:10.105 ******* 2020-11-20T11:12:02.586 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi112.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:02.586 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:02.588 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.624 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.044) 0:00:10.149 ******* 2020-11-20T11:12:02.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.030) 0:00:10.180 ******* 2020-11-20T11:12:02.659 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.041) 0:00:10.221 ******* 2020-11-20T11:12:02.701 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T11:12:02.702 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.738 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.042) 0:00:10.263 ******* 2020-11-20T11:12:02.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.030) 0:00:10.294 ******* 2020-11-20T11:12:02.774 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.042) 0:00:10.336 ******* 2020-11-20T11:12:02.816 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:12:02.818 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.041) 0:00:10.378 ******* 2020-11-20T11:12:02.858 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.894 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.041) 0:00:10.420 ******* 2020-11-20T11:12:02.901 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:12:02.903 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.936 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.042) 0:00:10.463 ******* 2020-11-20T11:12:02.943 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:02.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:02 +0000 (0:00:00.041) 0:00:10.504 ******* 2020-11-20T11:12:02.984 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:12:02.985 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T11:12:03.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.041) 0:00:10.546 ******* 2020-11-20T11:12:03.025 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T11:12:03.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.048) 0:00:10.594 ******* 2020-11-20T11:12:03.073 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:12:03.075 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:03.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.045) 0:00:10.640 ******* 2020-11-20T11:12:03.128 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:03.130 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:03.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.049) 0:00:10.689 ******* 2020-11-20T11:12:03.169 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T11:12:03.171 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:12:03.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.041) 0:00:10.730 ******* 2020-11-20T11:12:03.210 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:12:03.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.041) 0:00:10.772 ******* 2020-11-20T11:12:03.945 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605870723.8181012-oyriz5n6/katello-ca-consumer-latest.noarchs5gpfr7e.rpm"]} 2020-11-20T11:12:03.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:03 +0000 (0:00:00.733) 0:00:11.506 ******* 2020-11-20T11:12:04.551 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:12:04.553 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:12:04.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:04 +0000 (0:00:00.606) 0:00:12.113 ******* 2020-11-20T11:12:04.624 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:12:04.626 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:12:04.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:04 +0000 (0:00:00.072) 0:00:12.186 ******* 2020-11-20T11:12:08.326 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:12:08.328 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605870728.1540725-t9ny39qa/katello-ca-consumer-latest.noarch80n5q5va.rpm"]} 2020-11-20T11:12:08.360 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:08 +0000 (0:00:03.700) 0:00:15.886 ******* 2020-11-20T11:12:08.365 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605870728.1655588-luus0xv_/katello-ca-consumer-latest.noarchfefpdsgt.rpm"]} 2020-11-20T11:12:08.401 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:08 +0000 (0:00:00.041) 0:00:15.927 ******* 2020-11-20T11:12:08.914 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:12:08.916 INFO:teuthology.task.ansible.out:fatal: [smithi204.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:12:08.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:08 +0000 (0:00:00.560) 0:00:16.488 ******* 2020-11-20T11:12:08.967 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:12:09.003 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:09 +0000 (0:00:00.042) 0:00:16.530 ******* 2020-11-20T11:12:09.010 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:12:09.011 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:12:09.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:09 +0000 (0:00:00.051) 0:00:16.582 ******* 2020-11-20T11:12:09.063 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:12:09.099 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:09 +0000 (0:00:00.043) 0:00:16.625 ******* 2020-11-20T11:12:19.487 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:12:19.489 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:19.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:19 +0000 (0:00:10.423) 0:00:27.049 ******* 2020-11-20T11:12:19.560 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:12:19.562 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:12:19.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:19 +0000 (0:00:00.071) 0:00:27.121 ******* 2020-11-20T11:12:20.180 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:12:20.183 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.373770", "end": "2020-11-20 11:12:20.155895", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:19.782125", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:12:20.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:20 +0000 (0:00:00.618) 0:00:27.740 ******* 2020-11-20T11:12:20.240 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:12:20.242 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:20.273 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:20 +0000 (0:00:00.059) 0:00:27.799 ******* 2020-11-20T11:12:20.299 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:12:20.301 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:20.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:20 +0000 (0:00:00.059) 0:00:27.859 ******* 2020-11-20T11:12:20.360 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:12:20.361 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:20.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:20 +0000 (0:00:00.060) 0:00:27.919 ******* 2020-11-20T11:12:20.420 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:12:20.421 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:20.454 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:20 +0000 (0:00:00.060) 0:00:27.980 ******* 2020-11-20T11:12:22.814 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.160809", "end": "2020-11-20 11:12:22.786693", "rc": 0, "start": "2020-11-20 11:12:20.625884", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:12:22.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:22 +0000 (0:00:02.394) 0:00:30.374 ******* 2020-11-20T11:12:22.887 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:12:22.920 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:22 +0000 (0:00:00.072) 0:00:30.447 ******* 2020-11-20T11:12:22.959 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:12:22.961 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:23.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:23 +0000 (0:00:00.081) 0:00:30.528 ******* 2020-11-20T11:12:23.053 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:12:23.055 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:12:23.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:23 +0000 (0:00:00.089) 0:00:30.618 ******* 2020-11-20T11:12:23.132 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:12:23.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:23 +0000 (0:00:00.088) 0:00:30.707 ******* 2020-11-20T11:12:23.537 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:12:23.539 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:23.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:23 +0000 (0:00:00.392) 0:00:31.100 ******* 2020-11-20T11:12:23.612 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:12:23.614 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:12:23.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:23 +0000 (0:00:00.072) 0:00:31.173 ******* 2020-11-20T11:12:24.217 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.376572", "end": "2020-11-20 11:12:24.187116", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:23.810544", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:12:24.247 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.600) 0:00:31.774 ******* 2020-11-20T11:12:24.289 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:24.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.071) 0:00:31.845 ******* 2020-11-20T11:12:24.361 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:12:24.363 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:24.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.081) 0:00:31.927 ******* 2020-11-20T11:12:24.430 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:24.465 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.063) 0:00:31.991 ******* 2020-11-20T11:12:24.491 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:24.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.059) 0:00:32.051 ******* 2020-11-20T11:12:24.854 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:25.192 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:24 +0000 (0:00:00.364) 0:00:32.415 ******* TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} Friday 20 November 2020 11:12:24 +0000 (0:00:00.105) 0:00:32.521 ******* 2020-11-20T11:12:25.754 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:12:25.758 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.551238", "end": "2020-11-20 11:12:25.727766", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:25.176528", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:12:25.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:25 +0000 (0:00:00.798) 0:00:33.319 ******* 2020-11-20T11:12:25.847 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:12:25.849 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:25.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:25 +0000 (0:00:00.091) 0:00:33.410 ******* 2020-11-20T11:12:25.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:25 +0000 (0:00:00.032) 0:00:33.443 ******* 2020-11-20T11:12:25.944 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:25.985 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:25 +0000 (0:00:00.068) 0:00:33.511 ******* 2020-11-20T11:12:26.012 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:12:26.014 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:12:26.077 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:26 +0000 (0:00:00.091) 0:00:33.603 ******* 2020-11-20T11:12:26.109 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:26.141 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:26 +0000 (0:00:00.064) 0:00:33.668 ******* 2020-11-20T11:12:27.288 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:12:27.290 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.574751", "end": "2020-11-20 11:12:27.260562", "rc": 0, "start": "2020-11-20 11:12:24.685811", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:12:27.339 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:27 +0000 (0:00:01.197) 0:00:34.866 ******* 2020-11-20T11:12:27.380 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:12:27.382 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:12:27.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:27 +0000 (0:00:00.074) 0:00:34.940 ******* 2020-11-20T11:12:27.451 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:27.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:27 +0000 (0:00:00.070) 0:00:35.011 ******* 2020-11-20T11:12:27.521 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:12:27.523 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:12:27.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:27 +0000 (0:00:00.079) 0:00:35.090 ******* 2020-11-20T11:12:27.603 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:12:27.605 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:12:27.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:27 +0000 (0:00:00.083) 0:00:35.174 ******* 2020-11-20T11:12:28.660 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:12:28.661 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.324328", "end": "2020-11-20 11:12:28.638870", "rc": 0, "start": "2020-11-20 11:12:26.314542", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:12:28.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:28 +0000 (0:00:01.045) 0:00:36.219 ******* 2020-11-20T11:12:28.730 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:12:28.732 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:12:28.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:28 +0000 (0:00:00.070) 0:00:36.290 ******* 2020-11-20T11:12:28.792 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:12:28.794 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:28.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:28 +0000 (0:00:00.061) 0:00:36.351 ******* 2020-11-20T11:12:28.861 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:12:28.863 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:12:28.894 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:28 +0000 (0:00:00.069) 0:00:36.421 ******* 2020-11-20T11:12:28.931 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:12:28.933 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:12:28.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:28 +0000 (0:00:00.069) 0:00:36.490 ******* 2020-11-20T11:12:29.523 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:12:29.525 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.454865", "end": "2020-11-20 11:12:29.506210", "rc": 0, "start": "2020-11-20 11:12:26.051345", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:12:29.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:29 +0000 (0:00:00.593) 0:00:37.084 ******* 2020-11-20T11:12:29.743 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:12:29.744 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:12:29.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:29 +0000 (0:00:00.218) 0:00:37.302 ******* 2020-11-20T11:12:29.961 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:12:29.963 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:29.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:29 +0000 (0:00:00.220) 0:00:37.522 ******* 2020-11-20T11:12:30.227 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:30.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:30 +0000 (0:00:00.272) 0:00:37.795 ******* 2020-11-20T11:12:30.445 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:12:30.447 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:12:30.848 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:12:30.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:30 +0000 (0:00:00.614) 0:00:38.410 ******* 2020-11-20T11:12:31.330 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi112.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:12:31.489 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:31.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:31 +0000 (0:00:00.639) 0:00:39.050 ******* 2020-11-20T11:12:31.763 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi112.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:12:31.799 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:31 +0000 (0:00:00.275) 0:00:39.325 ******* 2020-11-20T11:12:31.826 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:12:31.828 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:31.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:31 +0000 (0:00:00.060) 0:00:39.386 ******* 2020-11-20T11:12:31.887 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:12:31.889 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:31.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:31 +0000 (0:00:00.061) 0:00:39.448 ******* 2020-11-20T11:12:31.952 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:12:31.954 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:31.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:31 +0000 (0:00:00.065) 0:00:39.513 ******* 2020-11-20T11:12:32.013 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:12:32.015 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.060) 0:00:39.573 ******* 2020-11-20T11:12:32.074 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:12:32.075 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.060) 0:00:39.634 ******* 2020-11-20T11:12:32.134 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.060) 0:00:39.694 ******* 2020-11-20T11:12:32.195 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:12:32.197 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.060) 0:00:39.755 ******* 2020-11-20T11:12:32.256 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:12:32.259 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.061) 0:00:39.816 ******* 2020-11-20T11:12:32.312 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:12:32.314 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:32.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:32 +0000 (0:00:00.054) 0:00:39.871 ******* 2020-11-20T11:12:33.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:12:33.525 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.004376", "end": "2020-11-20 11:12:33.500334", "rc": 0, "start": "2020-11-20 11:12:32.495958", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:12:33.562 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:33 +0000 (0:00:01.216) 0:00:41.088 ******* 2020-11-20T11:12:33.706 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.240222", "end": "2020-11-20 11:12:33.677770", "rc": 0, "start": "2020-11-20 11:12:30.437548", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:12:33.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:33 +0000 (0:00:00.179) 0:00:41.267 ******* 2020-11-20T11:12:33.939 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:12:33.940 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:12:33.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:33 +0000 (0:00:00.232) 0:00:41.499 ******* 2020-11-20T11:12:34.158 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:12:34.159 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:34.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:34 +0000 (0:00:00.220) 0:00:41.720 ******* 2020-11-20T11:12:34.642 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:12:34.644 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:12:34.991 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:12:34.993 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.283677", "end": "2020-11-20 11:12:34.970965", "rc": 0, "start": "2020-11-20 11:12:31.687288", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:12:35.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:35 +0000 (0:00:00.832) 0:00:42.552 ******* 2020-11-20T11:12:35.075 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:12:35.077 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:12:35.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:35 +0000 (0:00:00.091) 0:00:42.644 ******* 2020-11-20T11:12:35.229 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:12:35.266 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:35 +0000 (0:00:00.148) 0:00:42.793 ******* 2020-11-20T11:12:35.454 INFO:teuthology.task.ansible.out: 2020-11-20T11:12:35.456 INFO:teuthology.task.ansible.out:TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:12:35.458 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:35.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:35 +0000 (0:00:00.254) 0:00:43.047 ******* 2020-11-20T11:12:35.602 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:12:35.603 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:12:36.045 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:12:36.047 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:12:36.079 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:12:36.080 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:12:36.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.599) 0:00:43.647 ******* 2020-11-20T11:12:36.162 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.083) 0:00:43.731 ******* 2020-11-20T11:12:36.234 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:12:36.236 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.067) 0:00:43.798 ******* 2020-11-20T11:12:36.279 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:12:36.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.043) 0:00:43.842 ******* 2020-11-20T11:12:36.323 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.043) 0:00:43.885 ******* 2020-11-20T11:12:36.365 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.040) 0:00:43.925 ******* 2020-11-20T11:12:36.406 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.042) 0:00:43.968 ******* 2020-11-20T11:12:36.448 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:12:36.449 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.043) 0:00:44.011 ******* 2020-11-20T11:12:36.493 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.041) 0:00:44.053 ******* 2020-11-20T11:12:36.533 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:12:36.535 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:12:36.537 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:12:36.539 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.572 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.045) 0:00:44.098 ******* 2020-11-20T11:12:36.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.039) 0:00:44.137 ******* 2020-11-20T11:12:36.617 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:12:36.619 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.664 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.052) 0:00:44.190 ******* 2020-11-20T11:12:36.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.053) 0:00:44.244 ******* 2020-11-20T11:12:36.748 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.073) 0:00:44.318 ******* 2020-11-20T11:12:36.818 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:12:36.820 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.059) 0:00:44.378 ******* 2020-11-20T11:12:36.879 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:36.912 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:36 +0000 (0:00:00.060) 0:00:44.439 ******* 2020-11-20T11:12:37.111 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:12:37.114 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:12:37.168 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:12:37.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.303) 0:00:44.742 ******* 2020-11-20T11:12:37.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:12:37.524 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.419401", "end": "2020-11-20 11:12:37.500325", "rc": 0, "start": "2020-11-20 11:12:37.080924", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:12:37.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.342) 0:00:45.085 ******* 2020-11-20T11:12:37.565 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:12:37.567 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:12:37.604 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.045) 0:00:45.131 ******* 2020-11-20T11:12:37.632 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:12:37.633 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.063) 0:00:45.195 ******* 2020-11-20T11:12:37.695 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:12:37.696 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.060) 0:00:45.255 ******* 2020-11-20T11:12:37.756 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.062) 0:00:45.317 ******* 2020-11-20T11:12:37.817 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:12:37.820 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.853 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.062) 0:00:45.379 ******* 2020-11-20T11:12:37.880 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.061) 0:00:45.441 ******* 2020-11-20T11:12:37.941 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:12:37.943 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:37.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:37 +0000 (0:00:00.059) 0:00:45.500 ******* 2020-11-20T11:12:38.004 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:12:38.006 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:38.038 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:38 +0000 (0:00:00.063) 0:00:45.564 ******* 2020-11-20T11:12:38.066 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:38.104 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:38 +0000 (0:00:00.066) 0:00:45.630 ******* 2020-11-20T11:12:38.131 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:12:38.133 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:38.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:38 +0000 (0:00:00.060) 0:00:45.691 ******* 2020-11-20T11:12:38.521 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.180057", "end": "2020-11-20 11:12:38.500333", "rc": 0, "start": "2020-11-20 11:12:38.320276", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:12:38.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:38 +0000 (0:00:00.390) 0:00:46.081 ******* 2020-11-20T11:12:39.560 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:12:39.561 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:12:39.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:39 +0000 (0:00:01.039) 0:00:47.121 ******* 2020-11-20T11:12:40.048 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:40.050 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:12:40.335 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:12:40.337 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:12:40.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.786) 0:00:47.907 ******* 2020-11-20T11:12:40.408 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:12:40.410 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:40.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.060) 0:00:47.968 ******* 2020-11-20T11:12:40.469 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:40.471 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi112.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:12:40.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.065) 0:00:48.034 ******* 2020-11-20T11:12:40.537 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:12:40.539 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:40.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.070) 0:00:48.105 ******* 2020-11-20T11:12:40.606 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:12:40.608 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:40.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.080) 0:00:48.185 ******* 2020-11-20T11:12:40.870 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:40.872 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:12:40.910 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:40 +0000 (0:00:00.251) 0:00:48.437 ******* 2020-11-20T11:12:41.085 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:12:41.089 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:12:41.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.209) 0:00:48.646 ******* 2020-11-20T11:12:41.126 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:12:41.129 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:12:41.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.044) 0:00:48.691 ******* 2020-11-20T11:12:41.297 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:12:41.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.167) 0:00:48.858 ******* 2020-11-20T11:12:41.359 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:12:41.361 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:41.394 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.061) 0:00:48.920 ******* 2020-11-20T11:12:41.421 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:41.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.062) 0:00:48.983 ******* 2020-11-20T11:12:41.484 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:41.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.063) 0:00:49.046 ******* 2020-11-20T11:12:41.547 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:12:41.548 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi112.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:12:41.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:41 +0000 (0:00:00.062) 0:00:49.109 ******* 2020-11-20T11:12:41.945 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:12:41.999 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:12:42.001 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:12:42.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.450) 0:00:49.559 ******* 2020-11-20T11:12:42.335 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:12:42.337 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:12:42.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.340) 0:00:49.900 ******* 2020-11-20T11:12:42.400 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:12:42.402 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:42.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.060) 0:00:49.960 ******* 2020-11-20T11:12:42.471 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:12:42.473 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:12:42.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.076) 0:00:50.037 ******* 2020-11-20T11:12:42.695 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:12:42.697 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:42.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.219) 0:00:50.256 ******* 2020-11-20T11:12:42.767 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:12:42.769 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:42.778 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:42.789 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:42.801 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:42.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:42 +0000 (0:00:00.106) 0:00:50.362 ******* 2020-11-20T11:12:43.570 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:12:43.573 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:12:43.615 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:43 +0000 (0:00:00.778) 0:00:51.141 ******* 2020-11-20T11:12:44.090 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:44.092 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:12:44.387 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:12:44.388 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:12:44.421 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:44 +0000 (0:00:00.806) 0:00:51.948 ******* 2020-11-20T11:12:44.512 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:44.514 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:12:44.873 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:12:44.933 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:12:44.969 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:44 +0000 (0:00:00.548) 0:00:52.496 ******* 2020-11-20T11:12:45.151 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:12:45.153 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:12:45.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:45 +0000 (0:00:00.225) 0:00:52.721 ******* 2020-11-20T11:12:45.278 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:12:45.280 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:12:45.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:45 +0000 (0:00:00.139) 0:00:52.860 ******* 2020-11-20T11:12:45.342 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:45.344 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:12:45.365 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:12:45.367 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:45.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:45 +0000 (0:00:00.064) 0:00:52.925 ******* 2020-11-20T11:12:45.742 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:12:45.744 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:12:45.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:45 +0000 (0:00:00.380) 0:00:53.306 ******* 2020-11-20T11:12:45.808 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi204.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:12:45.961 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:12:45.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:45 +0000 (0:00:00.216) 0:00:53.522 ******* 2020-11-20T11:12:46.004 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:12:46.005 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:12:46.042 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.046) 0:00:53.569 ******* 2020-11-20T11:12:46.267 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:12:46.269 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:12:46.519 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:12:46.586 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:12:46.588 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:12:46.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.578) 0:00:54.147 ******* 2020-11-20T11:12:46.661 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi112.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:46.670 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:46.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.083) 0:00:54.230 ******* 2020-11-20T11:12:46.733 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:12:46.735 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:12:46.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.087) 0:00:54.318 ******* 2020-11-20T11:12:46.821 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:46.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.064) 0:00:54.382 ******* 2020-11-20T11:12:46.895 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:12:46.897 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:12:46.941 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.084) 0:00:54.467 ******* 2020-11-20T11:12:46.948 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:12:46.949 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:46.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:46 +0000 (0:00:00.054) 0:00:54.522 ******* 2020-11-20T11:12:47.018 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi166.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:12:47.129 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:12:47.131 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:47.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.173) 0:00:54.696 ******* 2020-11-20T11:12:47.224 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:12:47.226 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.241 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.250 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.262 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.132) 0:00:54.828 ******* 2020-11-20T11:12:47.309 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:12:47.311 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:12:47.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.049) 0:00:54.878 ******* 2020-11-20T11:12:47.393 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:12:47.394 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.073) 0:00:54.951 ******* 2020-11-20T11:12:47.466 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:12:47.471 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:12:47.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.093) 0:00:55.045 ******* 2020-11-20T11:12:47.548 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:12:47.549 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.063) 0:00:55.108 ******* 2020-11-20T11:12:47.631 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:12:47.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.083) 0:00:55.192 ******* 2020-11-20T11:12:47.857 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:12:47.858 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:12:47.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.227) 0:00:55.420 ******* 2020-11-20T11:12:47.942 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:47 +0000 (0:00:00.088) 0:00:55.508 ******* 2020-11-20T11:12:47.988 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:47.990 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:48.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:48 +0000 (0:00:00.048) 0:00:55.556 ******* 2020-11-20T11:12:48.564 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:12:48.565 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:10:47 UTC", "ActiveEnterTimestampMonotonic": "14998491", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount system.slice network.target nss-lookup.target sysinit.target basic.target -.mount systemd-tmpfiles-setup.service time-sync.target systemd-journald.socket var-run.mount local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:10:47 UTC", "AssertTimestampMonotonic": "14997403", "Before": "shutdown.target plymouth-quit.service multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:10:47 UTC", "ConditionTimestampMonotonic": "14997403", "ConfigurationDirectoryMode": " 2020-11-20T11:12:48.566 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "972", "ExecMainStartTimestamp": "Fri 2020-11-20 11:10:47 UTC", "ExecMainStartTimestampMonotonic": "14998452", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:47 UTC] ; stop_time=[n/a] ; pid=972 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:10:47 UTC", "InactiveExitTimestampMonotonic": "14998491", "InvocationID": "3e9ffaaeb9cc4eafaedc94cd32375f6e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:12:48.568 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "972", "MemoryAccounting": "yes", "MemoryCurrent": "1445888", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:12:48.570 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:10:47 UTC", "StateChangeTimestampMonotonic": "14998491", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:10:47 UTC", "WatchdogTimestampMonotonic": "14998490", "WatchdogUSec": "0"}} 2020-11-20T11:12:48.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:48 +0000 (0:00:00.569) 0:00:56.126 ******* 2020-11-20T11:12:48.776 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:12:48.778 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001676", "end": "2020-11-20 11:12:48.756612", "rc": 0, "start": "2020-11-20 11:12:48.754936", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:12:48.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:48 +0000 (0:00:00.211) 0:00:56.337 ******* 2020-11-20T11:12:49.807 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:12:49.841 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:49 +0000 (0:00:01.029) 0:00:57.367 ******* 2020-11-20T11:12:49.867 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:12:49.869 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:49.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:49 +0000 (0:00:00.060) 0:00:57.428 ******* 2020-11-20T11:12:50.334 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:12:50.336 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:12:50.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:50 +0000 (0:00:00.467) 0:00:57.895 ******* 2020-11-20T11:12:50.438 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:12:50.439 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:12:50.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:50 +0000 (0:00:00.104) 0:00:58.000 ******* 2020-11-20T11:12:50.500 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:12:50.502 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:50.533 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:50 +0000 (0:00:00.060) 0:00:58.060 ******* 2020-11-20T11:12:50.802 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:12:50.804 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:12:50.844 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:50 +0000 (0:00:00.310) 0:00:58.370 ******* 2020-11-20T11:12:50.881 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:12:50.883 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:50.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:50 +0000 (0:00:00.072) 0:00:58.442 ******* 2020-11-20T11:12:50.965 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:12:50.966 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:12:51.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.085) 0:00:58.528 ******* 2020-11-20T11:12:51.103 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:12:51.104 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:51.139 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.136) 0:00:58.665 ******* 2020-11-20T11:12:51.218 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:12:51.218 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:12:51.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.116) 0:00:58.782 ******* 2020-11-20T11:12:51.398 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:12:51.400 INFO:teuthology.task.ansible.out:fatal: [smithi204.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:12:51.436 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.180) 0:00:58.962 ******* 2020-11-20T11:12:51.442 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:12:51.444 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:12:51.478 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.041) 0:00:59.004 ******* 2020-11-20T11:12:51.484 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:12:51.485 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:51.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.047) 0:00:59.051 ******* 2020-11-20T11:12:51.530 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:12:51.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:12:51.570 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.043) 0:00:59.095 ******* 2020-11-20T11:12:51.778 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:12:51.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.243) 0:00:59.339 ******* 2020-11-20T11:12:51.959 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:12:51.961 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:12:51.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:51 +0000 (0:00:00.183) 0:00:59.522 ******* 2020-11-20T11:12:52.078 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:12:52.080 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:12:52.124 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.128) 0:00:59.650 ******* 2020-11-20T11:12:52.155 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:12:52.189 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.065) 0:00:59.715 ******* 2020-11-20T11:12:52.284 INFO:teuthology.task.ansible.out: 2020-11-20T11:12:52.285 INFO:teuthology.task.ansible.out:TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:12:52.287 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:11:03 UTC", "ActiveEnterTimestampMonotonic": "15330199", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount tmp.mount basic.target system.slice -.mount systemd-journald.socket nss-lookup.target systemd-tmpfiles-setup.service network.target time-sync.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:11:03 UTC", "AssertTimestampMonotonic": "15328976", "Before": "getty@tty1.service multi-user.target shutdown.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:11:03 UTC", "ConditionTimestampMonotonic": "15328976", "ConfigurationDirectoryMode": " 2020-11-20T11:12:52.288 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "990", "ExecMainStartTimestamp": "Fri 2020-11-20 11:11:03 UTC", "ExecMainStartTimestampMonotonic": "15330153", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:11:03 UTC] ; stop_time=[n/a] ; pid=990 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:11:03 UTC", "InactiveExitTimestampMonotonic": "15330199", "InvocationID": "3aa1c00c2fbd45b6a672bc19ed32bd61", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:12:52.290 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "990", "MemoryAccounting": "yes", "MemoryCurrent": "1515520", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:12:52.292 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:11:03 UTC", "StateChangeTimestampMonotonic": "15330199", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:11:03 UTC", "WatchdogTimestampMonotonic": "15330198", "WatchdogUSec": "0"}} 2020-11-20T11:12:52.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.143) 0:00:59.859 ******* 2020-11-20T11:12:52.508 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001608", "end": "2020-11-20 11:12:52.489435", "rc": 0, "start": "2020-11-20 11:12:52.487827", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:12:52.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.209) 0:01:00.068 ******* 2020-11-20T11:12:52.623 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:12:52.625 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:12:52.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.119) 0:01:00.188 ******* 2020-11-20T11:12:52.956 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:12:52.957 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:10:48 UTC", "ActiveEnterTimestampMonotonic": "15510238", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target sysinit.target basic.target nss-lookup.target local-fs.target -.mount system.slice network.target tmp.mount var-run.mount systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:10:48 UTC", "AssertTimestampMonotonic": "15508954", "Before": "multi-user.target getty@tty1.service plymouth-quit.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:10:48 UTC", "ConditionTimestampMonotonic": "15508954", "ConfigurationDirectoryMode": " 2020-11-20T11:12:52.959 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "973", "ExecMainStartTimestamp": "Fri 2020-11-20 11:10:48 UTC", "ExecMainStartTimestampMonotonic": "15510202", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:48 UTC] ; stop_time=[n/a] ; pid=973 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:10:48 UTC", "InactiveExitTimestampMonotonic": "15510238", "InvocationID": "6a40d182051c4c81b93e53da200d6fcc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:12:52.961 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "973", "MemoryAccounting": "yes", "MemoryCurrent": "1409024", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:12:52.963 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:10:48 UTC", "StateChangeTimestampMonotonic": "15510238", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:10:48 UTC", "WatchdogTimestampMonotonic": "15510237", "WatchdogUSec": "0"}} 2020-11-20T11:12:52.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:52 +0000 (0:00:00.333) 0:01:00.521 ******* 2020-11-20T11:12:53.184 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:12:53.186 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001699", "end": "2020-11-20 11:12:53.155160", "rc": 0, "start": "2020-11-20 11:12:53.153461", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:12:53.219 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:53 +0000 (0:00:00.224) 0:01:00.745 ******* 2020-11-20T11:12:53.695 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:12:53.697 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:12:53.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:53 +0000 (0:00:00.509) 0:01:01.255 ******* 2020-11-20T11:12:54.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:12:54.512 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:12:54.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:54 +0000 (0:00:00.814) 0:01:02.070 ******* 2020-11-20T11:12:54.962 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:12:54.964 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:12:55.000 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:54 +0000 (0:00:00.455) 0:01:02.526 ******* 2020-11-20T11:12:55.703 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:12:55.737 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:55 +0000 (0:00:00.737) 0:01:03.264 ******* 2020-11-20T11:12:57.445 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:12:57.447 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:12:57.482 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:57 +0000 (0:00:01.744) 0:01:05.009 ******* 2020-11-20T11:12:58.130 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:12:58.132 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:12:58.132 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:12:58.169 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:58 +0000 (0:00:00.686) 0:01:05.695 ******* 2020-11-20T11:12:58.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:58 +0000 (0:00:00.032) 0:01:05.728 ******* 2020-11-20T11:12:58.812 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:12:58.813 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:12:58.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:12:58 +0000 (0:00:00.655) 0:01:06.383 ******* 2020-11-20T11:13:10.820 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:13:10.822 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.092369", "end": "2020-11-20 11:13:10.797152", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:54.704783", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:13:10.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:10 +0000 (0:00:11.997) 0:01:18.381 ******* 2020-11-20T11:13:11.301 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:13:11.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:11 +0000 (0:00:00.479) 0:01:18.861 ******* 2020-11-20T11:13:11.527 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:13:11.529 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013089", "end": "2020-11-20 11:13:11.506959", "rc": 0, "start": "2020-11-20 11:13:11.493870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:11.562 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:11 +0000 (0:00:00.227) 0:01:19.088 ******* 2020-11-20T11:13:11.758 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002119", "end": "2020-11-20 11:13:11.736916", "rc": 0, "start": "2020-11-20 11:13:11.734797", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:11.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:11 +0000 (0:00:00.229) 0:01:19.318 ******* 2020-11-20T11:13:14.668 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:13:14.670 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.271094", "end": "2020-11-20 11:13:14.641682", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:58.370588", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:13:14.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:14 +0000 (0:00:02.913) 0:01:22.231 ******* 2020-11-20T11:13:15.154 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:13:15.156 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:13:15.188 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:15 +0000 (0:00:00.483) 0:01:22.714 ******* 2020-11-20T11:13:15.267 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:13:15.269 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.225893", "end": "2020-11-20 11:13:15.246757", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:12:59.020864", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:13:15.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:15 +0000 (0:00:00.114) 0:01:22.829 ******* 2020-11-20T11:13:15.382 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:13:15.384 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013670", "end": "2020-11-20 11:13:15.359937", "rc": 0, "start": "2020-11-20 11:13:15.346267", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:15.418 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:15 +0000 (0:00:00.115) 0:01:22.945 ******* 2020-11-20T11:13:15.604 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:13:15.605 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002155", "end": "2020-11-20 11:13:15.585261", "rc": 0, "start": "2020-11-20 11:13:15.583106", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:15.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:15 +0000 (0:00:00.222) 0:01:23.167 ******* 2020-11-20T11:13:15.752 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:13:15.754 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:13:15.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:15 +0000 (0:00:00.146) 0:01:23.314 ******* 2020-11-20T11:13:15.982 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:13:15.984 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009867", "end": "2020-11-20 11:13:15.958077", "rc": 0, "start": "2020-11-20 11:13:15.948210", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:16.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:16 +0000 (0:00:00.229) 0:01:23.543 ******* 2020-11-20T11:13:16.211 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:13:16.214 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010985", "end": "2020-11-20 11:13:16.189627", "rc": 0, "start": "2020-11-20 11:13:16.178642", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:16.247 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:16 +0000 (0:00:00.230) 0:01:23.773 ******* 2020-11-20T11:13:16.248 INFO:teuthology.task.ansible.out: 2020-11-20T11:13:28.168 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.195005", "end": "2020-11-20 11:13:28.144439", "rc": 0, "start": "2020-11-20 11:13:11.949434", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:28.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:11.975) 0:01:35.749 ******* 2020-11-20T11:13:28.422 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:13:28.424 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:13:28.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.235) 0:01:35.984 ******* 2020-11-20T11:13:28.486 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:28.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.062) 0:01:36.046 ******* 2020-11-20T11:13:28.560 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:13:28.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.072) 0:01:36.119 ******* 2020-11-20T11:13:28.620 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:13:28.622 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:28.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.061) 0:01:36.181 ******* 2020-11-20T11:13:28.681 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:28.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.061) 0:01:36.242 ******* 2020-11-20T11:13:28.764 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:13:28.766 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:13:28.801 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:28 +0000 (0:00:00.085) 0:01:36.328 ******* 2020-11-20T11:13:29.006 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:13:29.010 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:13:29.042 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.241) 0:01:36.569 ******* 2020-11-20T11:13:29.534 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:13:29.536 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870809.0685384-179818362990045/source", "state": "file", "uid": 0} 2020-11-20T11:13:29.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.525) 0:01:37.094 ******* 2020-11-20T11:13:29.598 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:13:29.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.076) 0:01:37.171 ******* 2020-11-20T11:13:29.710 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:29.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.113) 0:01:37.284 ******* 2020-11-20T11:13:29.810 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:13:29.812 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:13:29.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.088) 0:01:37.373 ******* 2020-11-20T11:13:29.879 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:29.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:29 +0000 (0:00:00.081) 0:01:37.454 ******* 2020-11-20T11:13:30.108 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:13:30.110 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:13:30.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:30 +0000 (0:00:00.214) 0:01:37.669 ******* 2020-11-20T11:13:30.330 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:13:30.332 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:13:30.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:30 +0000 (0:00:00.221) 0:01:37.890 ******* 2020-11-20T11:13:30.393 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:13:30.395 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:30.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:30 +0000 (0:00:00.065) 0:01:37.956 ******* 2020-11-20T11:13:30.457 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:30.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:30 +0000 (0:00:00.060) 0:01:38.016 ******* 2020-11-20T11:13:30.690 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi112.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:13:30.724 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:30 +0000 (0:00:00.233) 0:01:38.250 ******* 2020-11-20T11:13:31.268 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:13:31.270 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:13:31.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:31 +0000 (0:00:00.598) 0:01:38.849 ******* 2020-11-20T11:13:31.353 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:13:31.355 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi112"}, "changed": false} 2020-11-20T11:13:31.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:31 +0000 (0:00:00.073) 0:01:38.922 ******* 2020-11-20T11:13:32.066 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:13:32.068 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.244689", "end": "2020-11-20 11:13:32.044224", "rc": 0, "start": "2020-11-20 11:13:15.799535", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:32.101 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.704) 0:01:39.627 ******* 2020-11-20T11:13:32.306 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:13:32.308 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:13:32.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.253) 0:01:39.880 ******* 2020-11-20T11:13:32.383 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:13:32.387 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:32.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.074) 0:01:39.954 ******* 2020-11-20T11:13:32.435 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:13:32.437 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi112", "ansible_hostname": "smithi112", "ansible_nodename": "smithi112"}, "changed": false, "name": "smithi112"} 2020-11-20T11:13:32.472 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.044) 0:01:39.999 ******* 2020-11-20T11:13:32.479 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:13:32.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.050) 0:01:40.049 ******* 2020-11-20T11:13:32.551 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:13:32.553 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:32.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.077) 0:01:40.126 ******* 2020-11-20T11:13:32.609 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:13:32.611 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.133396", "end": "2020-11-20 11:13:32.542168", "rc": 0, "start": "2020-11-20 11:13:16.408772", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:32.646 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.046) 0:01:40.173 ******* 2020-11-20T11:13:32.653 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:13:32.655 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:32.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.050) 0:01:40.224 ******* 2020-11-20T11:13:32.761 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:13:32.762 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:13:32.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.101) 0:01:40.325 ******* 2020-11-20T11:13:32.847 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:13:32.848 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:13:32.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.092) 0:01:40.417 ******* 2020-11-20T11:13:32.920 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:32.963 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:32 +0000 (0:00:00.071) 0:01:40.489 ******* 2020-11-20T11:13:32.974 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:13:33.025 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.060) 0:01:40.549 ******* 2020-11-20T11:13:33.032 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} TASK [common : set_fact] ******************************************************* 2020-11-20T11:13:33.034 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:13:33.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.048) 0:01:40.597 ******* 2020-11-20T11:13:33.104 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.032) 0:01:40.630 ******* 2020-11-20T11:13:33.111 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:33.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.048) 0:01:40.679 ******* 2020-11-20T11:13:33.192 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:33.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.072) 0:01:40.752 ******* 2020-11-20T11:13:33.288 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:13:33.290 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:13:33.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.096) 0:01:40.848 ******* 2020-11-20T11:13:33.460 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:13:33.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.192) 0:01:41.041 ******* 2020-11-20T11:13:33.535 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:13:33.535 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:13:33.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.056) 0:01:41.097 ******* 2020-11-20T11:13:33.620 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:13:33.622 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870813.1468513-139602749049630/source", "state": "file", "uid": 0} 2020-11-20T11:13:33.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.086) 0:01:41.184 ******* 2020-11-20T11:13:33.685 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:13:33.687 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:13:33.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.066) 0:01:41.250 ******* 2020-11-20T11:13:33.774 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:33.808 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.083) 0:01:41.334 ******* 2020-11-20T11:13:33.845 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:13:33.846 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:13:33.880 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.072) 0:01:41.406 ******* 2020-11-20T11:13:33.918 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:33.954 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:33 +0000 (0:00:00.072) 0:01:41.479 ******* 2020-11-20T11:13:34.045 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:13:34.047 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605870813.5988362-265735128121556/source", "state": "file", "uid": 0} 2020-11-20T11:13:34.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.128) 0:01:41.608 ******* 2020-11-20T11:13:34.099 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:13:34.101 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:13:34.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.051) 0:01:41.660 ******* 2020-11-20T11:13:34.141 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:13:34.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.042) 0:01:41.702 ******* 2020-11-20T11:13:34.209 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.031) 0:01:41.734 ******* 2020-11-20T11:13:34.223 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:13:34.225 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:34.260 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.052) 0:01:41.787 ******* 2020-11-20T11:13:34.306 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:13:34.308 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:13:34.339 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.079) 0:01:41.866 ******* 2020-11-20T11:13:34.379 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:13:34.381 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:13:34.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.074) 0:01:41.941 ******* 2020-11-20T11:13:34.421 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:13:34.423 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:13:34.460 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.045) 0:01:41.986 ******* 2020-11-20T11:13:34.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:34.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.060) 0:01:42.047 ******* 2020-11-20T11:13:34.549 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:13:34.551 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:34.589 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.068) 0:01:42.115 ******* 2020-11-20T11:13:34.595 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:13:34.597 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:13:34.598 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:13:34.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.049) 0:01:42.165 ******* 2020-11-20T11:13:34.674 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.034) 0:01:42.200 ******* 2020-11-20T11:13:34.789 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:13:34.791 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:13:34.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.175) 0:01:42.375 ******* 2020-11-20T11:13:34.856 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:13:34.858 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:13:34.893 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.044) 0:01:42.419 ******* 2020-11-20T11:13:34.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.032) 0:01:42.452 ******* 2020-11-20T11:13:34.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:13:34.956 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:34.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:34 +0000 (0:00:00.064) 0:01:42.517 ******* 2020-11-20T11:13:35.018 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:35.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.067) 0:01:42.584 ******* 2020-11-20T11:13:35.075 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:13:35.077 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:13:35.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.061) 0:01:42.645 ******* 2020-11-20T11:13:35.264 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:13:35.266 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:13:35.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.182) 0:01:42.827 ******* 2020-11-20T11:13:35.329 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:13:35.330 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:13:35.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.066) 0:01:42.893 ******* 2020-11-20T11:13:35.373 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:13:35.375 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:13:35.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.043) 0:01:42.937 ******* 2020-11-20T11:13:35.452 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:13:35.454 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi204"}, "changed": false} 2020-11-20T11:13:35.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.082) 0:01:43.019 ******* 2020-11-20T11:13:35.833 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:13:35.835 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:13:35.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.385) 0:01:43.405 ******* 2020-11-20T11:13:35.887 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:13:35.890 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:13:35.924 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.045) 0:01:43.450 ******* 2020-11-20T11:13:35.934 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi166"}, "changed": false} 2020-11-20T11:13:35.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:35 +0000 (0:00:00.054) 0:01:43.505 ******* 2020-11-20T11:13:36.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:13:36.097 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi204", "ansible_hostname": "smithi204", "ansible_nodename": "smithi204"}, "changed": false, "name": "smithi204"} 2020-11-20T11:13:36.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:36 +0000 (0:00:00.154) 0:01:43.660 ******* 2020-11-20T11:13:36.377 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:13:36.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:36 +0000 (0:00:00.278) 0:01:43.938 ******* 2020-11-20T11:13:36.565 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi166", "ansible_hostname": "smithi166", "ansible_nodename": "smithi166"}, "changed": false, "name": "smithi166"} 2020-11-20T11:13:37.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:36 +0000 (0:00:00.188) 0:01:44.127 ******* TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} Friday 20 November 2020 11:13:36 +0000 (0:00:00.045) 0:01:44.172 ******* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} Friday 20 November 2020 11:13:37 +0000 (0:00:00.488) 0:01:44.660 ******* TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:13:37.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:37 +0000 (0:00:00.064) 0:01:44.725 ******* 2020-11-20T11:13:37.597 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:13:37.636 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:37 +0000 (0:00:00.437) 0:01:45.163 ******* 2020-11-20T11:13:37.819 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:13:37.820 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:13:37.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:37 +0000 (0:00:00.217) 0:01:45.380 ******* 2020-11-20T11:13:38.228 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:13:38.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.412) 0:01:45.793 ******* 2020-11-20T11:13:38.345 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:13:38.346 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:13:38.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.122) 0:01:45.916 ******* 2020-11-20T11:13:38.586 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.974814", "end": "2020-11-20 11:13:38.553648", "rc": 0, "start": "2020-11-20 11:13:36.578834", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:38.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.244) 0:01:46.161 ******* 2020-11-20T11:13:38.642 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:13:38.644 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:13:38.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.045) 0:01:46.206 ******* 2020-11-20T11:13:38.686 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:13:38.686 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:38.724 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.043) 0:01:46.250 ******* 2020-11-20T11:13:38.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:13:38.813 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.088) 0:01:46.339 ******* 2020-11-20T11:13:38.865 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:13:38.905 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:38 +0000 (0:00:00.092) 0:01:46.431 ******* 2020-11-20T11:13:38.998 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:13:39.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.129) 0:01:46.561 ******* 2020-11-20T11:13:39.107 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi204.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:13:39.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.106) 0:01:46.668 ******* 2020-11-20T11:13:39.192 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:13:39.193 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:13:39.231 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.089) 0:01:46.757 ******* 2020-11-20T11:13:39.239 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:13:39.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.043) 0:01:46.801 ******* 2020-11-20T11:13:39.281 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:13:39.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.041) 0:01:46.842 ******* 2020-11-20T11:13:39.343 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:13:39.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.064) 0:01:46.907 ******* 2020-11-20T11:13:39.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:39.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.064) 0:01:46.971 ******* 2020-11-20T11:13:39.474 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:13:39.477 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:13:39.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.066) 0:01:47.037 ******* 2020-11-20T11:13:39.518 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:13:39.519 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:13:39.557 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.046) 0:01:47.084 ******* 2020-11-20T11:13:39.585 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:13:39.586 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:13:39.587 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:13:39.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.064) 0:01:47.149 ******* 2020-11-20T11:13:39.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.030) 0:01:47.180 ******* 2020-11-20T11:13:39.661 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:13:39.663 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:39.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.043) 0:01:47.223 ******* 2020-11-20T11:13:39.736 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:13:39.738 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:39.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.076) 0:01:47.300 ******* 2020-11-20T11:13:39.811 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:13:39.813 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:39.847 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.073) 0:01:47.374 ******* 2020-11-20T11:13:39.949 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:13:39.951 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:13:39.998 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:39 +0000 (0:00:00.150) 0:01:47.525 ******* 2020-11-20T11:13:40.050 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:13:40.052 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006992", "end": "2020-11-20 11:13:40.018146", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:13:40.011154", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:13:40.105 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:40 +0000 (0:00:00.106) 0:01:47.632 ******* 2020-11-20T11:13:40.114 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:13:40.116 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:13:40.156 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:40 +0000 (0:00:00.050) 0:01:47.682 ******* 2020-11-20T11:13:40.164 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:40.212 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:40 +0000 (0:00:00.056) 0:01:47.738 ******* 2020-11-20T11:13:40.454 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:13:40.456 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:13:40.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:40 +0000 (0:00:00.285) 0:01:48.024 ******* 2020-11-20T11:13:42.398 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.054007", "end": "2020-11-20 11:13:42.370498", "rc": 0, "start": "2020-11-20 11:13:40.316491", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:42.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:42 +0000 (0:00:01.951) 0:01:49.975 ******* 2020-11-20T11:13:42.450 INFO:teuthology.task.ansible.out: 2020-11-20T11:13:42.502 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:42.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:42 +0000 (0:00:00.099) 0:01:50.075 ******* 2020-11-20T11:13:42.762 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.068974", "end": "2020-11-20 11:13:42.732073", "rc": 0, "start": "2020-11-20 11:13:40.663099", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:13:42.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:42 +0000 (0:00:00.248) 0:01:50.323 ******* 2020-11-20T11:13:42.837 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:13:42.841 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:42.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:42 +0000 (0:00:00.089) 0:01:50.413 ******* 2020-11-20T11:13:43.066 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:13:43.068 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:13:43.104 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.216) 0:01:50.630 ******* 2020-11-20T11:13:43.131 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:13:43.166 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.061) 0:01:50.692 ******* 2020-11-20T11:13:43.193 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:13:43.227 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.061) 0:01:50.753 ******* 2020-11-20T11:13:43.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:13:43.267 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.300 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.072) 0:01:50.826 ******* 2020-11-20T11:13:43.338 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:13:43.340 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.351 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.097) 0:01:50.924 ******* 2020-11-20T11:13:43.404 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:13:43.406 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:13:43.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.043) 0:01:50.968 ******* 2020-11-20T11:13:43.449 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.043) 0:01:51.011 ******* 2020-11-20T11:13:43.492 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:13:43.532 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.047) 0:01:51.059 ******* 2020-11-20T11:13:43.539 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:13:43.540 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.044) 0:01:51.103 ******* 2020-11-20T11:13:43.583 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:13:43.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.043) 0:01:51.147 ******* 2020-11-20T11:13:43.628 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:13:43.630 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.046) 0:01:51.193 ******* 2020-11-20T11:13:43.674 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.042) 0:01:51.235 ******* 2020-11-20T11:13:43.714 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:13:43.716 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.750 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.041) 0:01:51.277 ******* 2020-11-20T11:13:43.757 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:13:43.759 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.796 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.045) 0:01:51.323 ******* 2020-11-20T11:13:43.823 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:13:43.825 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.061) 0:01:51.384 ******* 2020-11-20T11:13:43.884 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:13:43.886 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:43.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.060) 0:01:51.444 ******* 2020-11-20T11:13:43.945 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:13:43.946 INFO:teuthology.task.ansible.out:fatal: [smithi204.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007044", "end": "2020-11-20 11:13:43.924205", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:13:43.917161", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:13:43.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:43 +0000 (0:00:00.060) 0:01:51.505 ******* 2020-11-20T11:13:43.984 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:13:43.986 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:44.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:44 +0000 (0:00:00.040) 0:01:51.545 ******* 2020-11-20T11:13:44.025 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:13:44.027 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:44.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:44 +0000 (0:00:00.041) 0:01:51.586 ******* 2020-11-20T11:13:44.066 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:13:44.068 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:44.101 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:44 +0000 (0:00:00.041) 0:01:51.628 ******* 2020-11-20T11:13:44.295 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:13:44.296 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007168", "end": "2020-11-20 11:13:44.273101", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:13:44.265933", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:13:44.329 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:44 +0000 (0:00:00.228) 0:01:51.856 ******* 2020-11-20T11:13:44.367 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:13:44.368 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:13:44.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:44 +0000 (0:00:00.075) 0:01:51.932 ******* 2020-11-20T11:13:46.439 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:13:46.441 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:13:46.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:46 +0000 (0:00:02.073) 0:01:54.005 ******* 2020-11-20T11:13:50.296 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:13:50.343 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:50 +0000 (0:00:03.863) 0:01:57.869 ******* 2020-11-20T11:13:50.580 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:13:50.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:50 +0000 (0:00:00.302) 0:01:58.171 ******* 2020-11-20T11:13:52.202 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:13:52.204 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:13:52.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:52 +0000 (0:00:01.592) 0:01:59.764 ******* 2020-11-20T11:13:56.119 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:13:56.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:56 +0000 (0:00:03.916) 0:02:03.680 ******* 2020-11-20T11:13:56.356 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:13:56.395 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:56 +0000 (0:00:00.240) 0:02:03.921 ******* 2020-11-20T11:13:59.033 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:13:59.034 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:13:59.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:13:59 +0000 (0:00:02.693) 0:02:06.615 ******* 2020-11-20T11:14:01.463 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:14:01.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:01 +0000 (0:00:02.409) 0:02:09.025 ******* 2020-11-20T11:14:03.026 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:14:03.027 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2020-11-20T11:14:03.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:03 +0000 (0:00:01.573) 0:02:10.598 ******* 2020-11-20T11:14:03.126 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:14:03.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:03 +0000 (0:00:00.092) 0:02:10.691 ******* 2020-11-20T11:14:03.927 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:14:04.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:03 +0000 (0:00:00.796) 0:02:11.487 ******* TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:14:04 +0000 (0:00:00.064) 0:02:11.552 ******* TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target dbus.socket dbus.service sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_ 2020-11-20T11:14:04.671 INFO:teuthology.task.ansible.out:wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ip6tables.service ebtables.service iptables.service ipset.service nftables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCOR 2020-11-20T11:14:04.674 INFO:teuthology.task.ansible.out:E": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", 2020-11-20T11:14:04.676 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} Friday 20 November 2020 11:14:04 +0000 (0:00:00.346) 0:02:11.899 ******* TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:14:04.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:04 +0000 (0:00:00.321) 0:02:12.220 ******* 2020-11-20T11:14:05.461 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:14:05.462 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:14:05.495 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.801) 0:02:13.021 ******* 2020-11-20T11:14:05.523 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:14:05.525 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:05.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.064) 0:02:13.085 ******* 2020-11-20T11:14:05.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:14:05.579 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:14:05.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.055) 0:02:13.140 ******* 2020-11-20T11:14:05.620 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:14:05.622 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:14:05.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.046) 0:02:13.187 ******* 2020-11-20T11:14:05.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.034) 0:02:13.221 ******* 2020-11-20T11:14:05.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:14:05.704 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:05.738 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.043) 0:02:13.265 ******* 2020-11-20T11:14:05.767 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:14:05.769 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:05.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.066) 0:02:13.331 ******* 2020-11-20T11:14:05.833 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:14:05.835 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:05.868 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.063) 0:02:13.395 ******* 2020-11-20T11:14:05.898 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:05.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:05 +0000 (0:00:00.063) 0:02:13.458 ******* 2020-11-20T11:14:05.960 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:14:06.017 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.084) 0:02:13.543 ******* 2020-11-20T11:14:06.046 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.064) 0:02:13.607 ******* 2020-11-20T11:14:06.108 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:14:06.110 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.060) 0:02:13.668 ******* 2020-11-20T11:14:06.179 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:14:06.181 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.072) 0:02:13.741 ******* 2020-11-20T11:14:06.241 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:14:06.243 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.061) 0:02:13.803 ******* 2020-11-20T11:14:06.304 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:14:06.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.082) 0:02:13.885 ******* 2020-11-20T11:14:06.385 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:14:06.388 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.422 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.063) 0:02:13.949 ******* 2020-11-20T11:14:06.451 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:14:06.453 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.066) 0:02:14.015 ******* 2020-11-20T11:14:06.516 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:14:06.518 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.062) 0:02:14.078 ******* 2020-11-20T11:14:06.580 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:14:06.582 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.615 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.063) 0:02:14.141 ******* 2020-11-20T11:14:06.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.682 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.062) 0:02:14.204 ******* 2020-11-20T11:14:06.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:14:06.708 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.063) 0:02:14.267 ******* 2020-11-20T11:14:06.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:14:06.770 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.061) 0:02:14.328 ******* 2020-11-20T11:14:06.830 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:14:06.832 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.866 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.064) 0:02:14.393 ******* 2020-11-20T11:14:06.896 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:06.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.072) 0:02:14.466 ******* 2020-11-20T11:14:06.968 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:06 +0000 (0:00:00.065) 0:02:14.531 ******* 2020-11-20T11:14:07.043 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:14:07.044 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.073) 0:02:14.605 ******* 2020-11-20T11:14:07.106 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:14:07.108 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.062) 0:02:14.668 ******* 2020-11-20T11:14:07.168 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:14:07.170 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.060) 0:02:14.728 ******* 2020-11-20T11:14:07.234 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:14:07.236 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.070) 0:02:14.799 ******* 2020-11-20T11:14:07.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:14:07.303 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.061) 0:02:14.861 ******* 2020-11-20T11:14:07.367 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:14:07.368 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.412 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.078) 0:02:14.939 ******* 2020-11-20T11:14:07.440 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:14:07.441 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.060) 0:02:14.999 ******* 2020-11-20T11:14:07.502 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.061) 0:02:15.061 ******* 2020-11-20T11:14:07.563 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.596 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.060) 0:02:15.122 ******* 2020-11-20T11:14:07.636 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:14:07.638 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.074) 0:02:15.197 ******* 2020-11-20T11:14:07.698 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:14:07.699 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.732 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.061) 0:02:15.258 ******* 2020-11-20T11:14:07.760 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.062) 0:02:15.321 ******* 2020-11-20T11:14:07.823 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.062) 0:02:15.383 ******* 2020-11-20T11:14:07.895 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:14:07.896 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.932 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.075) 0:02:15.459 ******* 2020-11-20T11:14:07.959 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:14:07.961 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:07.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:07 +0000 (0:00:00.060) 0:02:15.519 ******* 2020-11-20T11:14:08.031 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.096 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.099) 0:02:15.618 ******* 2020-11-20T11:14:08.110 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:14:08.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.059) 0:02:15.678 ******* 2020-11-20T11:14:08.164 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.048) 0:02:15.726 ******* 2020-11-20T11:14:08.254 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.051) 0:02:15.778 ******* 2020-11-20T11:14:08.258 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:14:08.260 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.047) 0:02:15.825 ******* 2020-11-20T11:14:08.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.043) 0:02:15.869 ******* 2020-11-20T11:14:08.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.072) 0:02:15.942 ******* 2020-11-20T11:14:08.429 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:08.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.048) 0:02:15.990 ******* 2020-11-20T11:14:08.477 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.064) 0:02:16.055 ******* 2020-11-20T11:14:08.558 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.559 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:08.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.065) 0:02:16.120 ******* 2020-11-20T11:14:08.625 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.075) 0:02:16.195 ******* 2020-11-20T11:14:08.687 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:08.689 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target polkit.service dbus.socket system.slice dbus.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ebtables.service nftables.service ipset.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin 2020-11-20T11:14:08.691 INFO:teuthology.task.ansible.out:": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft" 2020-11-20T11:14:08.692 INFO:teuthology.task.ansible.out:: "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "nul 2020-11-20T11:14:08.694 INFO:teuthology.task.ansible.out:l", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:14:08.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.061) 0:02:16.257 ******* 2020-11-20T11:14:08.736 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:14:08.738 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.056) 0:02:16.314 ******* 2020-11-20T11:14:08.797 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:14:08.799 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target system.slice dbus.socket basic.target polkit.service dbus.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service iptables.service ip6tables.service shutdown.target ebtables.service nftables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:14:08.801 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:14:08.803 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:14:08.805 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:14:08.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.053) 0:02:16.367 ******* 2020-11-20T11:14:08.848 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:14:08.849 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:08.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:08 +0000 (0:00:00.048) 0:02:16.415 ******* 2020-11-20T11:14:09.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:14:08 +0000 (0:00:00.103) 0:02:16.519 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi204.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring Friday 20 November 2020 11:14:09 +0000 (0:00:00.080) 0:02:16.600 ******* Friday 20 November 2020 11:14:09 +0000 (0:00:00.037) 0:02:16.637 ******* TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.042) 0:02:16.680 ******* 2020-11-20T11:14:09.183 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:14:09.185 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.082) 0:02:16.763 ******* 2020-11-20T11:14:09.243 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:14:09.244 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:14:09.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.044) 0:02:16.807 ******* 2020-11-20T11:14:09.287 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:14:09.289 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.336 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.054) 0:02:16.862 ******* 2020-11-20T11:14:09.365 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.064) 0:02:16.926 ******* 2020-11-20T11:14:09.409 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:14:09.411 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:14:09.465 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.060) 0:02:16.987 ******* 2020-11-20T11:14:09.470 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.044) 0:02:17.031 ******* 2020-11-20T11:14:09.514 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:14:09.517 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.044) 0:02:17.076 ******* TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.607 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.056) 0:02:17.133 ******* 2020-11-20T11:14:09.616 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.618 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:14:09.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.043) 0:02:17.177 ******* 2020-11-20T11:14:09.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.041) 0:02:17.218 ******* 2020-11-20T11:14:09.699 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:14:09.701 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.051) 0:02:17.270 ******* 2020-11-20T11:14:09.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.049) 0:02:17.319 ******* 2020-11-20T11:14:09.799 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:14:09.801 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.045) 0:02:17.365 ******* 2020-11-20T11:14:09.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.035) 0:02:17.401 ******* 2020-11-20T11:14:09.882 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:14:09.883 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:09.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.051) 0:02:17.453 ******* 2020-11-20T11:14:09.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.033) 0:02:17.486 ******* 2020-11-20T11:14:09.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:14:09.969 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:09 +0000 (0:00:00.041) 0:02:17.527 ******* 2020-11-20T11:14:10.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.034) 0:02:17.562 ******* 2020-11-20T11:14:10.042 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:14:10.044 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.084 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.048) 0:02:17.610 ******* 2020-11-20T11:14:10.116 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.031) 0:02:17.642 ******* 2020-11-20T11:14:10.127 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.042) 0:02:17.685 ******* 2020-11-20T11:14:10.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.031) 0:02:17.716 ******* 2020-11-20T11:14:10.200 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:14:10.203 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.206 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.060) 0:02:17.776 ******* 2020-11-20T11:14:10.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.031) 0:02:17.808 ******* 2020-11-20T11:14:10.288 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:14:10.291 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.044) 0:02:17.852 ******* 2020-11-20T11:14:10.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.032) 0:02:17.885 ******* 2020-11-20T11:14:10.366 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.041) 0:02:17.927 ******* 2020-11-20T11:14:10.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.040) 0:02:17.967 ******* 2020-11-20T11:14:10.449 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:14:10.451 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.051) 0:02:18.019 ******* 2020-11-20T11:14:10.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.038) 0:02:18.058 ******* 2020-11-20T11:14:10.538 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:14:10.540 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:14:10.589 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.057) 0:02:18.115 ******* 2020-11-20T11:14:10.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.051) 0:02:18.166 ******* 2020-11-20T11:14:10.648 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:14:10.650 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.051) 0:02:18.218 ******* 2020-11-20T11:14:10.704 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi112.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.706 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.706 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:14:10.708 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.708 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.074) 0:02:18.293 ******* 2020-11-20T11:14:10.809 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.042) 0:02:18.335 ******* 2020-11-20T11:14:10.817 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:14:10.819 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.054) 0:02:18.390 ******* 2020-11-20T11:14:10.873 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.051) 0:02:18.441 ******* 2020-11-20T11:14:10.922 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.924 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.043) 0:02:18.484 ******* 2020-11-20T11:14:10.965 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:14:10.966 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:10.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:10 +0000 (0:00:00.041) 0:02:18.526 ******* 2020-11-20T11:14:11.006 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.007 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi112.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005832", "end": "2020-11-20 11:14:10.972893", "rc": 0, "start": "2020-11-20 11:14:10.967061", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:14:11.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.047) 0:02:18.573 ******* 2020-11-20T11:14:11.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.033) 0:02:18.607 ******* 2020-11-20T11:14:11.087 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:14:11.089 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.089 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.053) 0:02:18.660 ******* 2020-11-20T11:14:11.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.035) 0:02:18.696 ******* 2020-11-20T11:14:11.180 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.066) 0:02:18.763 ******* 2020-11-20T11:14:11.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.064) 0:02:18.828 ******* 2020-11-20T11:14:11.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:14:11.314 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:14:11.314 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.051) 0:02:18.879 ******* 2020-11-20T11:14:11.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.049) 0:02:18.929 ******* 2020-11-20T11:14:11.418 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.457 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.053) 0:02:18.982 ******* 2020-11-20T11:14:11.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.050) 0:02:19.033 ******* 2020-11-20T11:14:11.523 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:14:11.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.066) 0:02:19.099 ******* 2020-11-20T11:14:11.580 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:14:11.582 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.636 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.062) 0:02:19.162 ******* 2020-11-20T11:14:11.647 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:14:11.648 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.056) 0:02:19.218 ******* 2020-11-20T11:14:11.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:14:11.706 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.050) 0:02:19.269 ******* 2020-11-20T11:14:11.750 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.049) 0:02:19.319 ******* 2020-11-20T11:14:11.799 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:14:11.801 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.044) 0:02:19.364 ******* 2020-11-20T11:14:11.844 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:14:11.846 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.046) 0:02:19.411 ******* 2020-11-20T11:14:11.892 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:14:11.894 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.931 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.047) 0:02:19.458 ******* 2020-11-20T11:14:11.938 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:14:11.940 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:11.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:11 +0000 (0:00:00.046) 0:02:19.505 ******* 2020-11-20T11:14:11.986 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:14:11.988 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.025 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.047) 0:02:19.552 ******* 2020-11-20T11:14:12.036 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:14:12.040 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.079 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.050) 0:02:19.602 ******* 2020-11-20T11:14:12.088 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.144 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.068) 0:02:19.670 ******* 2020-11-20T11:14:12.158 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.051) 0:02:19.721 ******* 2020-11-20T11:14:12.202 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:14:12.204 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.050) 0:02:19.772 ******* 2020-11-20T11:14:12.253 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:14:12.255 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.049) 0:02:19.822 ******* 2020-11-20T11:14:12.304 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:14:12.310 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.048) 0:02:19.871 ******* 2020-11-20T11:14:12.351 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.390 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.045) 0:02:19.916 ******* 2020-11-20T11:14:12.397 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.432 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.042) 0:02:19.958 ******* 2020-11-20T11:14:12.438 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:14:12.441 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.042) 0:02:20.001 ******* 2020-11-20T11:14:12.482 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.049) 0:02:20.051 ******* 2020-11-20T11:14:12.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:14:12.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.042) 0:02:20.093 ******* 2020-11-20T11:14:12.573 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:14:12.575 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.044) 0:02:20.137 ******* 2020-11-20T11:14:12.618 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.672 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.061) 0:02:20.199 ******* 2020-11-20T11:14:12.679 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:14:12.707 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.050) 0:02:20.250 ******* 2020-11-20T11:14:12.735 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.067) 0:02:20.317 ******* 2020-11-20T11:14:12.800 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.079) 0:02:20.397 ******* 2020-11-20T11:14:12.885 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.055) 0:02:20.452 ******* 2020-11-20T11:14:12.936 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:12.975 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:12 +0000 (0:00:00.047) 0:02:20.500 ******* 2020-11-20T11:14:12.980 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.015 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.541 ******* 2020-11-20T11:14:13.021 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:14:13.023 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.583 ******* 2020-11-20T11:14:13.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.624 ******* 2020-11-20T11:14:13.104 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:14:13.106 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.139 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.666 ******* 2020-11-20T11:14:13.149 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.184 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.707 ******* 2020-11-20T11:14:13.187 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.749 ******* 2020-11-20T11:14:13.229 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:14:13.231 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:20.790 ******* 2020-11-20T11:14:13.272 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.045) 0:02:20.836 ******* 2020-11-20T11:14:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:14:13.317 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.044) 0:02:20.880 ******* 2020-11-20T11:14:13.362 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.050) 0:02:20.931 ******* 2020-11-20T11:14:13.415 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.064) 0:02:20.996 ******* 2020-11-20T11:14:13.480 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.053) 0:02:21.049 ******* 2020-11-20T11:14:13.532 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.056) 0:02:21.105 ******* 2020-11-20T11:14:13.593 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.058) 0:02:21.164 ******* 2020-11-20T11:14:13.645 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:14:13.647 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.683 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.045) 0:02:21.209 ******* 2020-11-20T11:14:13.689 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:13.691 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.042) 0:02:21.251 ******* 2020-11-20T11:14:13.735 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.044) 0:02:21.296 ******* 2020-11-20T11:14:13.777 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.041) 0:02:21.338 ******* 2020-11-20T11:14:13.819 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.042) 0:02:21.380 ******* 2020-11-20T11:14:13.861 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:13.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.045) 0:02:21.425 ******* 2020-11-20T11:14:13.907 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:14:13.910 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:14:13.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.044) 0:02:21.470 ******* 2020-11-20T11:14:13.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:13 +0000 (0:00:00.033) 0:02:21.504 ******* 2020-11-20T11:14:13.985 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.045 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.064) 0:02:21.569 ******* 2020-11-20T11:14:14.057 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420973568, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153558, 'block_used': 12941550, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153558, "block_size": 4096, "block_total": 240095108, "block_used": 12941550, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420973568, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} TASK [testnode : Install packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.049) 0:02:21.618 ******* 2020-11-20T11:14:14.125 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.032) 0:02:21.651 ******* 2020-11-20T11:14:14.135 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.075) 0:02:21.726 ******* 2020-11-20T11:14:14.209 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.046) 0:02:21.772 ******* 2020-11-20T11:14:14.253 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:14:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.289 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.042) 0:02:21.815 ******* 2020-11-20T11:14:14.296 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:14:14.301 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.304 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004870", "end": "2020-11-20 11:14:14.260653", "rc": 0, "start": "2020-11-20 11:14:14.255783", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:14.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.059) 0:02:21.874 ******* 2020-11-20T11:14:14.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.032) 0:02:21.907 ******* 2020-11-20T11:14:14.397 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.052) 0:02:21.959 ******* 2020-11-20T11:14:14.439 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:14:14.452 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420973568, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153558, 'block_used': 12941550, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153558, "block_size": 4096, "block_total": 240095108, "block_used": 12941550, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420973568, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.055) 0:02:22.015 ******* 2020-11-20T11:14:14.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.036) 0:02:22.051 ******* 2020-11-20T11:14:14.535 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:14:14.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.043) 0:02:22.094 ******* 2020-11-20T11:14:14.601 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.032) 0:02:22.127 ******* 2020-11-20T11:14:14.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.664 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.061) 0:02:22.188 ******* 2020-11-20T11:14:14.677 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.058) 0:02:22.247 ******* 2020-11-20T11:14:14.735 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.049) 0:02:22.296 ******* 2020-11-20T11:14:14.785 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.047) 0:02:22.344 ******* 2020-11-20T11:14:14.824 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:14:14.826 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.864 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.045) 0:02:22.390 ******* 2020-11-20T11:14:14.870 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:14.872 INFO:teuthology.task.ansible.out:TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:14:14.872 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.045) 0:02:22.435 ******* 2020-11-20T11:14:14.910 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:14.916 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:14.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.043) 0:02:22.478 ******* TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:14 +0000 (0:00:00.045) 0:02:22.524 ******* 2020-11-20T11:14:15.006 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.050) 0:02:22.575 ******* 2020-11-20T11:14:15.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:14:15.057 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.094 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.044) 0:02:22.620 ******* 2020-11-20T11:14:15.100 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:14:15.102 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.137 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.043) 0:02:22.663 ******* 2020-11-20T11:14:15.145 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.189 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.043) 0:02:22.707 ******* TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.045) 0:02:22.752 ******* 2020-11-20T11:14:15.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:14:15.235 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.048) 0:02:22.801 ******* 2020-11-20T11:14:15.282 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:14:15.285 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.052) 0:02:22.853 ******* 2020-11-20T11:14:15.337 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.047) 0:02:22.900 ******* 2020-11-20T11:14:15.379 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:14:15.382 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.040) 0:02:22.941 ******* 2020-11-20T11:14:15.421 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:14:15.422 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.047) 0:02:22.988 ******* 2020-11-20T11:14:15.468 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.042) 0:02:23.031 ******* 2020-11-20T11:14:15.511 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:14:15.514 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.044) 0:02:23.076 ******* 2020-11-20T11:14:15.556 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:14:15.566 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.043) 0:02:23.119 ******* 2020-11-20T11:14:15.605 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.047) 0:02:23.166 ******* 2020-11-20T11:14:15.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:14:15.649 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.044) 0:02:23.210 ******* 2020-11-20T11:14:15.695 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.044) 0:02:23.255 ******* 2020-11-20T11:14:15.735 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.041) 0:02:23.297 ******* 2020-11-20T11:14:15.778 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.045) 0:02:23.343 ******* 2020-11-20T11:14:15.830 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.045) 0:02:23.389 ******* 2020-11-20T11:14:15.880 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.051) 0:02:23.440 ******* 2020-11-20T11:14:15.920 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.041) 0:02:23.482 ******* 2020-11-20T11:14:15.962 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:14:15.967 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:15.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:15 +0000 (0:00:00.041) 0:02:23.523 ******* 2020-11-20T11:14:16.003 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:14:16.005 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.044 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.047) 0:02:23.570 ******* 2020-11-20T11:14:16.046 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:16.053 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:14:16.056 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBhHH1faRAOR5C9nE2NnOB6usDTs5plgt3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.243831", "end": "2020-11-20 11:14:16.000801", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBhHH1faRAOR5C9nE2NnOB6usDTs5plgt3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:14.756970", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destro 2020-11-20T11:14:16.058 INFO:teuthology.task.ansible.out:yed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:16.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.051) 0:02:23.622 ******* 2020-11-20T11:14:16.101 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:14:16.105 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.137 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.042) 0:02:23.664 ******* 2020-11-20T11:14:16.143 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:14:16.145 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.043) 0:02:23.707 ******* 2020-11-20T11:14:16.187 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:14:16.188 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.041) 0:02:23.749 ******* 2020-11-20T11:14:16.229 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:14:16.231 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.046) 0:02:23.796 ******* 2020-11-20T11:14:16.276 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:14:16.278 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.044) 0:02:23.840 ******* 2020-11-20T11:14:16.320 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:14:16.322 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.042) 0:02:23.883 ******* 2020-11-20T11:14:16.365 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.042) 0:02:23.925 ******* 2020-11-20T11:14:16.405 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:14:16.407 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.045) 0:02:23.970 ******* 2020-11-20T11:14:16.451 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:14:16.453 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.487 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.043) 0:02:24.014 ******* 2020-11-20T11:14:16.496 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.532 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.043) 0:02:24.057 ******* 2020-11-20T11:14:16.538 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.041) 0:02:24.099 ******* 2020-11-20T11:14:16.581 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.041) 0:02:24.141 ******* 2020-11-20T11:14:16.620 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:14:16.621 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.042) 0:02:24.183 ******* 2020-11-20T11:14:16.664 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:14:16.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.046) 0:02:24.230 ******* 2020-11-20T11:14:16.711 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:14:16.713 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.049) 0:02:24.280 ******* 2020-11-20T11:14:16.767 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi204.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi204.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:14:16.769 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.778 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.780 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.790 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:16.792 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi204.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.074) 0:02:24.354 ******* 2020-11-20T11:14:16.835 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.877 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.048) 0:02:24.403 ******* 2020-11-20T11:14:16.884 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.886 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi166.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.886 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.913 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.915 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.924 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:16.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:16 +0000 (0:00:00.095) 0:02:24.499 ******* 2020-11-20T11:14:17.089 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi204.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010641", "end": "2020-11-20 11:14:17.065758", "rc": 0, "start": "2020-11-20 11:14:17.055117", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:14:17.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.154) 0:02:24.654 ******* 2020-11-20T11:14:17.166 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.207 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.079) 0:02:24.733 ******* 2020-11-20T11:14:17.213 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:14:17.215 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010514", "end": "2020-11-20 11:14:17.151156", "rc": 0, "start": "2020-11-20 11:14:17.140642", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:14:17.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.048) 0:02:24.782 ******* 2020-11-20T11:14:17.264 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.048) 0:02:24.830 ******* 2020-11-20T11:14:17.312 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.314 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-nTOJCA-6Rtb-fAm1-AwFN-nxp0-m2g7-PPN2MQ', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN', 'nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.079256", "end": "2020-11-20 11:14:17.274967", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-nTOJCA-6Rtb-fAm1-AwFN-nxp0-m2g7-PPN2MQ", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN", "nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:16.195711", "stderr": "", "stde 2020-11-20T11:14:17.316 INFO:teuthology.task.ansible.out:rr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:17.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.054) 0:02:24.885 ******* TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:14:17.370 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.047) 0:02:24.932 ******* 2020-11-20T11:14:17.412 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:14:17.415 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.042) 0:02:24.975 ******* 2020-11-20T11:14:17.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:14:17.461 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.492 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.044) 0:02:25.019 ******* 2020-11-20T11:14:17.501 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.044) 0:02:25.064 ******* 2020-11-20T11:14:17.565 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:14:17.569 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:17.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:17 +0000 (0:00:00.061) 0:02:25.125 ******* 2020-11-20T11:14:18.539 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQB29VnetiuOHC45T9eE56CXErz1XCBVspO'], 'uuids': ['2c210601-ca9c-410d-82f5-d2711c45c350'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.048985", "end": "2020-11-20 11:14:18.510832", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQB29VnetiuOHC45T9eE56CXErz1XCBVspO"], "labels": [], "masters": [], "uuids": ["2c210601-ca9c-410d-82f5-d2711c45c350"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:17.461847", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-11-20T11:14:18.541 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2020-11-20T11:14:19.795 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBbfCvh4JDgp3eGgFQtyyZS8npimdUkk1b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.070079", "end": "2020-11-20 11:14:19.760901", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBbfCvh4JDgp3eGgFQtyyZS8npimdUkk1b"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:18.690822", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:19.957 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:14:19.988 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:19 +0000 (0:00:02.388) 0:02:27.514 ******* 2020-11-20T11:14:20.028 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:14:20.032 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:14:20.077 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.086) 0:02:27.601 ******* 2020-11-20T11:14:20.083 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:14:20.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.043) 0:02:27.644 ******* 2020-11-20T11:14:20.169 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:14:20.171 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:14:20.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.089) 0:02:27.733 ******* 2020-11-20T11:14:20.308 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005009", "end": "2020-11-20 11:14:20.270018", "rc": 0, "start": "2020-11-20 11:14:20.265009", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:20.352 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.145) 0:02:27.879 ******* 2020-11-20T11:14:20.392 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi204.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:20.426 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.073) 0:02:27.952 ******* 2020-11-20T11:14:20.442 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:14:20.444 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004935", "end": "2020-11-20 11:14:20.418418", "rc": 0, "start": "2020-11-20 11:14:20.413483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:20.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.060) 0:02:28.012 ******* 2020-11-20T11:14:20.493 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:14:20.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.043) 0:02:28.055 ******* 2020-11-20T11:14:20.535 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:14:20.537 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:20.581 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.043) 0:02:28.099 ******* 2020-11-20T11:14:20.610 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:14:20.651 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:20 +0000 (0:00:00.078) 0:02:28.177 ******* 2020-11-20T11:14:21.040 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:14:21.042 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBlWjvImHorbZO1fLkDfdSzuskyJoZtrYa'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061355", "end": "2020-11-20 11:14:21.011079", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBlWjvImHorbZO1fLkDfdSzuskyJoZtrYa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:19.949724", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:21.053 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-35000c50091e2ee9d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS', 'wwn-0x5000c50091e2ee9d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QZGS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2ee9d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-35000c50091e2ee9d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'wwn-0x5000c50091e2ee9d-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-35000c50091e2ee9d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS", "wwn-0x5000c50091e2ee9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:21.055 INFO:teuthology.task.ansible.out:Z1W5QZGS-part1", "scsi-35000c50091e2ee9d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "wwn-0x5000c50091e2ee9d-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QZGS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2ee9d"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:21.995 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jldHWfTykhGEswDSCGtA3UuAKNZMtcW3s'], 'uuids': ['0953f9c8-4f84-41ef-9841-a4fe7be8fb35'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.237777", "end": "2020-11-20 11:14:21.957967", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jldHWfTykhGEswDSCGtA3UuAKNZMtcW3s"], "labels": [], "masters": [], "uuids": ["0953f9c8-4f84-41ef-9841-a4fe7be8fb35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:20.720190", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:22.123 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7orQg3ajQpy7U1vHsMYF37SlOvDE8EhQR4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.256451", "end": "2020-11-20 11:14:22.083884", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7orQg3ajQpy7U1vHsMYF37SlOvDE8EhQR4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:20.827433", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:22.308 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBqKa0n7R52vFumOTMcO210vlfaIDzJ1FK'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.075055", "end": "2020-11-20 11:14:22.277821", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBqKa0n7R52vFumOTMcO210vlfaIDzJ1FK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:21.202766", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:22.347 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:22 +0000 (0:00:01.695) 0:02:29.873 ******* 2020-11-20T11:14:22.714 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBhHH1faRAOR5C9nE2NnOB6usDTs5plgt3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139793", "end": "2020-11-20 11:14:22.679878", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBhHH1faRAOR5C9nE2NnOB6usDTs5plgt3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:22.540085", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137113 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137113 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:22.915 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-nTOJCA-6Rtb-fAm1-AwFN-nxp0-m2g7-PPN2MQ', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN', 'nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.035552", "end": "2020-11-20 11:14:22.892165", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-nTOJCA-6Rtb-fAm1-AwFN-nxp0-m2g7-PPN2MQ", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN", "nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:22.856613", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0331681 s, 3.5 GB/s", "std 2020-11-20T11:14:22.917 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0331681 s, 3.5 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:23.234 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQB29VnetiuOHC45T9eE56CXErz1XCBVspO'], 'uuids': ['2c210601-ca9c-410d-82f5-d2711c45c350'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.143846", "end": "2020-11-20 11:14:23.209060", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQB29VnetiuOHC45T9eE56CXErz1XCBVspO"], "labels": [], "masters": [], "uuids": ["2c210601-ca9c-410d-82f5-d2711c45c350"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:23.065214", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141261 s, 817 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141261 s, 817 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:23.247 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:14:23.247 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-BbNfXq-uMH0-lKlU-RNIs-AMoB-L5BL-yJ3Ihn', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN', 'nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.079424", "end": "2020-11-20 11:14:23.221908", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-BbNfXq-uMH0-lKlU-RNIs-AMoB-L5BL-yJ3Ihn", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN", "nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:22.142484", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:14:23.249 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:23.409 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-AKtCSm-0151-KCuM-0X9j-5gkx-dHgX-vklsXo', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.102679", "end": "2020-11-20 11:14:23.380087", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AKtCSm-0151-KCuM-0X9j-5gkx-dHgX-vklsXo", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:22.277408", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:14:23.411 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:23.553 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBbfCvh4JDgp3eGgFQtyyZS8npimdUkk1b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.147844", "end": "2020-11-20 11:14:23.523072", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBbfCvh4JDgp3eGgFQtyyZS8npimdUkk1b"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:23.375228", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145319 s, 794 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145319 s, 794 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:23.865 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBlWjvImHorbZO1fLkDfdSzuskyJoZtrYa'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.145241", "end": "2020-11-20 11:14:23.842153", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBlWjvImHorbZO1fLkDfdSzuskyJoZtrYa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:23.696912", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142685 s, 808 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142685 s, 808 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:23.878 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-35000c50091e2ee9d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS', 'wwn-0x5000c50091e2ee9d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QZGS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2ee9d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-35000c50091e2ee9d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'wwn-0x5000c50091e2ee9d-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-35000c50091e2ee9d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS", "wwn-0x5000c50091e2ee9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:23.880 INFO:teuthology.task.ansible.out:Z1W5QZGS-part1", "scsi-35000c50091e2ee9d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "wwn-0x5000c50091e2ee9d-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QZGS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2ee9d"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:24.180 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBqKa0n7R52vFumOTMcO210vlfaIDzJ1FK'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138809", "end": "2020-11-20 11:14:24.156735", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ugDAIGuyKYcu8ALjYQxq5Xqcgq695aQBqKa0n7R52vFumOTMcO210vlfaIDzJ1FK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:24.017926", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136297 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136297 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:24.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:24 +0000 (0:00:01.874) 0:02:31.747 ******* 2020-11-20T11:14:24.463 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.052293", "end": "2020-11-20 11:14:24.427664", "rc": 0, "start": "2020-11-20 11:14:24.375371", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:24.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:24 +0000 (0:00:00.277) 0:02:32.025 ******* 2020-11-20T11:14:24.505 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:14:24.507 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jPPFUPccttpt6yMM0Nc23zg9ah84eZ5pU'], 'uuids': ['c04c0ef0-13d3-4382-b3d1-0787938ecee8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.059649", "end": "2020-11-20 11:14:24.458347", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jPPFUPccttpt6yMM0Nc23zg9ah84eZ5pU"], "labels": [], "masters": [], "uuids": ["c04c0ef0-13d3-4382-b3d1-0787938ecee8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:23.398698", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:24.673 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oQYJdZi6UvPnwksV4R51I8igX7MnXUQsS'], 'uuids': ['85a034ee-f914-4604-85fd-f8dcd2b18274'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.078299", "end": "2020-11-20 11:14:24.643628", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oQYJdZi6UvPnwksV4R51I8igX7MnXUQsS"], "labels": [], "masters": [], "uuids": ["85a034ee-f914-4604-85fd-f8dcd2b18274"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:23.565329", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:24.771 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.055121", "end": "2020-11-20 11:14:24.739609", "rc": 0, "start": "2020-11-20 11:14:24.684488", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:24.809 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:24 +0000 (0:00:00.310) 0:02:32.335 ******* 2020-11-20T11:14:24.840 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:14:24.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:24 +0000 (0:00:00.069) 0:02:32.404 ******* 2020-11-20T11:14:24.906 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:24.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:24 +0000 (0:00:00.064) 0:02:32.469 ******* 2020-11-20T11:14:24.970 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.062) 0:02:32.531 ******* 2020-11-20T11:14:25.032 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.063) 0:02:32.595 ******* 2020-11-20T11:14:25.096 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:14:25.098 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.061) 0:02:32.657 ******* 2020-11-20T11:14:25.314 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:14:25.317 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:14:25.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.227) 0:02:32.885 ******* 2020-11-20T11:14:25.401 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420973568, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153558, 'block_used': 12941550, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153558, "block_size": 4096, "block_total": 240095108, "block_used": 12941550, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420973568, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.073) 0:02:32.958 ******* 2020-11-20T11:14:25.470 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:14:25.472 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.071) 0:02:33.030 ******* 2020-11-20T11:14:25.533 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.064) 0:02:33.094 ******* 2020-11-20T11:14:25.595 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:25.597 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.630 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.061) 0:02:33.156 ******* 2020-11-20T11:14:25.668 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:14:25.670 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.073) 0:02:33.230 ******* 2020-11-20T11:14:25.731 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:14:25.732 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:25.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.061) 0:02:33.291 ******* 2020-11-20T11:14:25.792 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:14:25.795 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jUVCPOdIJ8HFElfXhyLeLo9daMREWiDgU'], 'uuids': ['a98a38e1-d25d-4955-8c7f-a38f0b256397'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.088765", "end": "2020-11-20 11:14:25.767555", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jUVCPOdIJ8HFElfXhyLeLo9daMREWiDgU"], "labels": [], "masters": [], "uuids": ["a98a38e1-d25d-4955-8c7f-a38f0b256397"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:24.678790", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot 2020-11-20T11:14:25.797 INFO:teuthology.task.ansible.out: or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:25.831 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:25 +0000 (0:00:00.065) 0:02:33.357 ******* 2020-11-20T11:14:25.950 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7o3f8lj2bUb12mejfTCoayxvue5ovct86i'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.086067", "end": "2020-11-20 11:14:25.915559", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7o3f8lj2bUb12mejfTCoayxvue5ovct86i"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:24.829492", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:26.548 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:14:26.588 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:26 +0000 (0:00:00.756) 0:02:34.114 ******* 2020-11-20T11:14:27.058 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:14:27.060 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jOPBdYU8yi6ubQPkEGqTVmkVw8sSYJEUC'], 'uuids': ['b805780e-6e5f-4527-bf01-fe57d8456e03'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061192", "end": "2020-11-20 11:14:27.024719", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jOPBdYU8yi6ubQPkEGqTVmkVw8sSYJEUC"], "labels": [], "masters": [], "uuids": ["b805780e-6e5f-4527-bf01-fe57d8456e03"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:25.963527", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:27.075 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XP2E', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E', 'scsi-35000c50092941a36', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E', 'wwn-0x5000c50092941a36'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XP2E', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941a36', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E-part1', 'scsi-35000c50092941a36-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E-part1', 'wwn-0x5000c50092941a36-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E", "scsi-35000c50092941a36", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E", "wwn-0x5000c50092941a36"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:27.077 INFO:teuthology.task.ansible.out:Z1W5XP2E-part1", "scsi-35000c50092941a36-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E-part1", "wwn-0x5000c50092941a36-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP2E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941a36"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:27.241 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oZeCMtZJS4Y6qrJAvafVsqTo8N24CVkfg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.086868", "end": "2020-11-20 11:14:27.204357", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oZeCMtZJS4Y6qrJAvafVsqTo8N24CVkfg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:26.117489", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:27.254 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS', 'scsi-35000c5009293883c', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XMNS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293883c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'scsi-35000c5009293883c-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS", "scsi-35000c5009293883c", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:27.257 INFO:teuthology.task.ansible.out:Z1W5XMNS-part1", "scsi-35000c5009293883c-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:27.267 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:14:27.269 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:27.589 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:27.927 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:28.256 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:28.341 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:14:28.344 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jfvBqdcNFArGmQSmkoWGncmbUgcniGQdW'], 'uuids': ['a0f4facf-61ea-4c5c-a680-f0d68e358262'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072321", "end": "2020-11-20 11:14:28.310467", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jfvBqdcNFArGmQSmkoWGncmbUgcniGQdW"], "labels": [], "masters": [], "uuids": ["a0f4facf-61ea-4c5c-a680-f0d68e358262"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:27.238146", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:28.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:28 +0000 (0:00:01.798) 0:02:35.912 ******* 2020-11-20T11:14:28.523 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7owcr21e4ux8qpS4f1qM9Mofle69PKHd7u'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.090165", "end": "2020-11-20 11:14:28.488670", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7owcr21e4ux8qpS4f1qM9Mofle69PKHd7u"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:27.398505", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:14:28.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:28 +0000 (0:00:00.177) 0:02:36.090 ******* 2020-11-20T11:14:28.584 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:28.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:28 +0000 (0:00:00.058) 0:02:36.149 ******* 2020-11-20T11:14:28.750 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jldHWfTykhGEswDSCGtA3UuAKNZMtcW3s'], 'uuids': ['0953f9c8-4f84-41ef-9841-a4fe7be8fb35'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138773", "end": "2020-11-20 11:14:28.716036", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jldHWfTykhGEswDSCGtA3UuAKNZMtcW3s"], "labels": [], "masters": [], "uuids": ["0953f9c8-4f84-41ef-9841-a4fe7be8fb35"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:28.577263", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135935 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135935 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:28.806 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:14:28.925 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} Friday 20 November 2020 11:14:28 +0000 (0:00:00.244) 0:02:36.393 ******* TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7orQg3ajQpy7U1vHsMYF37SlOvDE8EhQR4'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139177", "end": "2020-11-20 11:14:28.887723", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7orQg3ajQpy7U1vHsMYF37SlOvDE8EhQR4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:28.748546", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136518 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136518 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:28.977 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-BbNfXq-uMH0-lKlU-RNIs-AMoB-L5BL-yJ3Ihn', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN', 'nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037812", "end": "2020-11-20 11:14:28.925935", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-BbNfXq-uMH0-lKlU-RNIs-AMoB-L5BL-yJ3Ihn", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN", "nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:28.888123", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0351707 s, 3.3 GB/s", "std 2020-11-20T11:14:28.979 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0351707 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:29.108 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:29.110 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:29.152 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:14:29.154 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-AKtCSm-0151-KCuM-0X9j-5gkx-dHgX-vklsXo', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037319", "end": "2020-11-20 11:14:29.118436", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AKtCSm-0151-KCuM-0X9j-5gkx-dHgX-vklsXo", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.081117", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0347161 s, 3.3 GB/s", "std 2020-11-20T11:14:29.155 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0347161 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:29.317 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jPPFUPccttpt6yMM0Nc23zg9ah84eZ5pU'], 'uuids': ['c04c0ef0-13d3-4382-b3d1-0787938ecee8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139995", "end": "2020-11-20 11:14:29.256562", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jPPFUPccttpt6yMM0Nc23zg9ah84eZ5pU"], "labels": [], "masters": [], "uuids": ["c04c0ef0-13d3-4382-b3d1-0787938ecee8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.116567", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137399 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137399 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:29.408 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:29.731 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:14:29.737 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jUVCPOdIJ8HFElfXhyLeLo9daMREWiDgU'], 'uuids': ['a98a38e1-d25d-4955-8c7f-a38f0b256397'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138607", "end": "2020-11-20 11:14:29.592744", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jUVCPOdIJ8HFElfXhyLeLo9daMREWiDgU"], "labels": [], "masters": [], "uuids": ["a98a38e1-d25d-4955-8c7f-a38f0b256397"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.454137", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135978 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135978 s, 848 MB/s"], "stdout": "", "stdout_lines": []} changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oQYJdZi6UvPnwksV4R51I8igX7MnXUQsS'], 'uuids': ['85a034ee-f914-4604-85fd-f8dcd2b18274'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': ' 2020-11-20T11:14:29.739 INFO:teuthology.task.ansible.out:512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139282", "end": "2020-11-20 11:14:29.629253", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oQYJdZi6UvPnwksV4R51I8igX7MnXUQsS"], "labels": [], "masters": [], "uuids": ["85a034ee-f914-4604-85fd-f8dcd2b18274"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.489971", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136659 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136659 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:29.763 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:29.764 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:29.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:29 +0000 (0:00:00.937) 0:02:37.330 ******* 2020-11-20T11:14:30.002 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:14:30.005 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7o3f8lj2bUb12mejfTCoayxvue5ovct86i'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.149693", "end": "2020-11-20 11:14:29.966395", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7o3f8lj2bUb12mejfTCoayxvue5ovct86i"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.816702", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147128 s, 784 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147128 s, 784 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.050 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:14:30.088 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.283) 0:02:37.614 ******* 2020-11-20T11:14:30.110 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:14:30.119 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jOPBdYU8yi6ubQPkEGqTVmkVw8sSYJEUC'], 'uuids': ['b805780e-6e5f-4527-bf01-fe57d8456e03'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140730", "end": "2020-11-20 11:14:30.080509", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jOPBdYU8yi6ubQPkEGqTVmkVw8sSYJEUC"], "labels": [], "masters": [], "uuids": ["b805780e-6e5f-4527-bf01-fe57d8456e03"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:29.939779", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138151 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138151 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XP2E', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E', 'scsi-35000c50092941a36', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E', 'wwn-0x5000c50092941a36'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XP2E', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941a36', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E-part1', 'scsi-35000c50092941a36-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E-part1', 'wwn-0x5000c50092941a36-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XP2E", "scsi-35000c50092941a36", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E", "wwn-0x5000c50092941a36"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XP2E-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:30.123 INFO:teuthology.task.ansible.out:Z1W5XP2E-part1", "scsi-35000c50092941a36-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XP2E-part1", "wwn-0x5000c50092941a36-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP2E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941a36"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:30.134 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:14:30.136 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:30.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.105) 0:02:37.720 ******* 2020-11-20T11:14:30.343 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oZeCMtZJS4Y6qrJAvafVsqTo8N24CVkfg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140086", "end": "2020-11-20 11:14:30.318026", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7oZeCMtZJS4Y6qrJAvafVsqTo8N24CVkfg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:30.177940", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137495 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137495 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.354 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS', 'scsi-35000c5009293883c', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XMNS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293883c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'scsi-35000c5009293883c-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XMNS", "scsi-35000c5009293883c", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XMNS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:14:30.356 INFO:teuthology.task.ansible.out:Z1W5XMNS-part1", "scsi-35000c5009293883c-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:30.454 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jfvBqdcNFArGmQSmkoWGncmbUgcniGQdW'], 'uuids': ['a0f4facf-61ea-4c5c-a680-f0d68e358262'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138937", "end": "2020-11-20 11:14:30.430834", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CjAcHYHxWvZmbgW5ipvpfygbMTRW2o9jfvBqdcNFArGmQSmkoWGncmbUgcniGQdW"], "labels": [], "masters": [], "uuids": ["a0f4facf-61ea-4c5c-a680-f0d68e358262"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:30.291897", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136302 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136302 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.308) 0:02:38.028 ******* 2020-11-20T11:14:30.616 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi112.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:14:30.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.151) 0:02:38.180 ******* 2020-11-20T11:14:30.675 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:14:30.677 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7owcr21e4ux8qpS4f1qM9Mofle69PKHd7u'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.137552", "end": "2020-11-20 11:14:30.640107", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-emojH2mrKoFeDqwDsoFDyMRs3UAk1V7owcr21e4ux8qpS4f1qM9Mofle69PKHd7u"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:14:30.502555", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134945 s, 855 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134945 s, 855 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.095) 0:02:38.276 ******* 2020-11-20T11:14:30.795 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:14:30.797 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.052733", "end": "2020-11-20 11:14:30.747554", "rc": 0, "start": "2020-11-20 11:14:30.694821", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:30.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:30 +0000 (0:00:00.090) 0:02:38.366 ******* 2020-11-20T11:14:31.097 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.063206", "end": "2020-11-20 11:14:31.060837", "rc": 0, "start": "2020-11-20 11:14:30.997631", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:31.099 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:14:31.099 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043943", "end": "2020-11-20 11:14:31.067456", "rc": 0, "start": "2020-11-20 11:14:31.023513", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:31.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.306) 0:02:38.673 ******* 2020-11-20T11:14:31.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.044) 0:02:38.718 ******* 2020-11-20T11:14:31.209 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:14:31.211 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:14:31.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.062) 0:02:38.780 ******* 2020-11-20T11:14:31.262 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:14:31.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.060) 0:02:38.840 ******* 2020-11-20T11:14:31.321 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:14:31.323 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.052) 0:02:38.893 ******* 2020-11-20T11:14:31.374 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:14:31.376 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.424 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.056) 0:02:38.949 ******* 2020-11-20T11:14:31.432 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043204", "end": "2020-11-20 11:14:31.362675", "rc": 0, "start": "2020-11-20 11:14:31.319471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:31.433 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.477 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.053) 0:02:39.003 ******* 2020-11-20T11:14:31.516 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.038) 0:02:39.042 ******* 2020-11-20T11:14:31.524 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:14:31.526 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.047) 0:02:39.090 ******* 2020-11-20T11:14:31.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.031) 0:02:39.121 ******* 2020-11-20T11:14:31.601 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:14:31.604 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.043) 0:02:39.165 ******* 2020-11-20T11:14:31.673 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.034) 0:02:39.199 ******* 2020-11-20T11:14:31.679 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:14:31.681 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.045) 0:02:39.244 ******* 2020-11-20T11:14:31.752 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.033) 0:02:39.278 ******* 2020-11-20T11:14:31.758 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.759 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.041) 0:02:39.320 ******* 2020-11-20T11:14:31.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.033) 0:02:39.354 ******* 2020-11-20T11:14:31.834 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.836 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.043) 0:02:39.398 ******* 2020-11-20T11:14:31.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.034) 0:02:39.432 ******* 2020-11-20T11:14:31.913 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:31.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.064) 0:02:39.497 ******* 2020-11-20T11:14:32.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:31 +0000 (0:00:00.034) 0:02:39.531 ******* 2020-11-20T11:14:32.011 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:14:32.013 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.055) 0:02:39.587 ******* 2020-11-20T11:14:32.067 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:14:32.068 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.105 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.044) 0:02:39.631 ******* 2020-11-20T11:14:32.111 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:14:32.113 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.041) 0:02:39.673 ******* 2020-11-20T11:14:32.153 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:14:32.154 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.044) 0:02:39.717 ******* 2020-11-20T11:14:32.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.031) 0:02:39.748 ******* 2020-11-20T11:14:32.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.049) 0:02:39.797 ******* 2020-11-20T11:14:32.279 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:14:32.281 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.053) 0:02:39.851 ******* 2020-11-20T11:14:32.365 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:14:32.368 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.079) 0:02:39.931 ******* 2020-11-20T11:14:32.413 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:14:32.414 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:14:32.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.053) 0:02:39.985 ******* 2020-11-20T11:14:32.467 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:32.469 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.052) 0:02:40.037 ******* 2020-11-20T11:14:32.517 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:14:32.519 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.043) 0:02:40.081 ******* 2020-11-20T11:14:32.561 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:32.563 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.598 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.043) 0:02:40.124 ******* 2020-11-20T11:14:32.604 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:14:32.606 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.042) 0:02:40.167 ******* 2020-11-20T11:14:32.648 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.043) 0:02:40.210 ******* 2020-11-20T11:14:32.690 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:32.691 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.044) 0:02:40.254 ******* 2020-11-20T11:14:32.735 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:14:32.736 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.738 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:14:32.775 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.047) 0:02:40.302 ******* 2020-11-20T11:14:32.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.036) 0:02:40.338 ******* 2020-11-20T11:14:32.818 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:32.820 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.044) 0:02:40.382 ******* 2020-11-20T11:14:32.863 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:32.865 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.902 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.046) 0:02:40.429 ******* 2020-11-20T11:14:32.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:32.951 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:32 +0000 (0:00:00.048) 0:02:40.477 ******* 2020-11-20T11:14:32.989 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:14:32.991 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:33.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.073) 0:02:40.551 ******* 2020-11-20T11:14:33.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:33.054 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:14:33.055 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:10:47 UTC", "ActiveEnterTimestampMonotonic": "15140466", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sntp.service basic.target tmp.mount -.mount systemd-journald.socket sysinit.target ntpd.service system.slice ntpdate.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:10:46 UTC", "AssertTimestampMonotonic": "13850775", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:10:46 UTC", "ConditionTimestampMonotonic": "13850739", "ConfigurationDirectoryMode": "0755" 2020-11-20T11:14:33.056 INFO:teuthology.task.ansible.out:, "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "889", "ExecMainStartTimestamp": "Fri 2020-11-20 11:10:47 UTC", "ExecMainStartTimestampMonotonic": "14988761", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:46 UTC] ; stop_time=[Fri 2020-11-20 11:10:47 UTC] ; pid=873 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:47 UTC] ; stop_time=[Fri 2020-11-20 11:10:47 UTC] ; pid=968 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:10:46 UTC", "InactiveExitTimestampMonotonic": "13868336", "InvocationID": "a850a607703e465e9f23c52f685ec0a4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity 2020-11-20T11:14:33.058 INFO:teuthology.task.ansible.out:", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "889", "MemoryAccounting": "yes", "MemoryCurrent": "3506176", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualSt 2020-11-20T11:14:33.059 INFO:teuthology.task.ansible.out:art": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:10:47 UTC", "StateChangeTimestampMonotonic": "15140466", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:10:47 UTC", "WatchdogTimestampMonotonic": "14988775", "WatchdogUSec": "0"}} 2020-11-20T11:14:33.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.064) 0:02:40.615 ******* 2020-11-20T11:14:33.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.032) 0:02:40.648 ******* 2020-11-20T11:14:33.130 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:14:33.166 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.044) 0:02:40.692 ******* 2020-11-20T11:14:33.194 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:33.195 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:14:33.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.061) 0:02:40.754 ******* 2020-11-20T11:14:33.254 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:14:33.256 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:33.288 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.060) 0:02:40.815 ******* 2020-11-20T11:14:33.315 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:14:33.317 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:33.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.061) 0:02:40.876 ******* 2020-11-20T11:14:33.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:14:33.357 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:14:33.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.043) 0:02:40.919 ******* 2020-11-20T11:14:33.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:14:33.400 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:33.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.041) 0:02:40.961 ******* 2020-11-20T11:14:33.600 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:14:33.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.214) 0:02:41.176 ******* 2020-11-20T11:14:33.656 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:14:33.658 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:14:33.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:33 +0000 (0:00:00.043) 0:02:41.220 ******* 2020-11-20T11:14:33.763 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:14:33.765 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.019 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.021 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:34.087 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.142 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:14:34.185 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:34 +0000 (0:00:00.491) 0:02:41.711 ******* 2020-11-20T11:14:34.335 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:14:34.336 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.401 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.666 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.732 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:34.966 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:35.042 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:35.083 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.898) 0:02:42.610 ******* 2020-11-20T11:14:35.286 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:14:35.288 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:14:35.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.238) 0:02:42.848 ******* 2020-11-20T11:14:35.339 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:14:35.341 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:14:35.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.054) 0:02:42.903 ******* 2020-11-20T11:14:35.389 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:35.391 INFO:teuthology.task.ansible.out:TASK [testnode : Install packages via pip] ************************************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:14:35.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.063) 0:02:42.967 ******* 2020-11-20T11:14:35.469 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:35.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.062) 0:02:43.029 ******* 2020-11-20T11:14:35.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:14:35.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.063) 0:02:43.092 ******* 2020-11-20T11:14:35.572 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:35.574 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:35.576 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:14:35.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.045) 0:02:43.138 ******* 2020-11-20T11:14:35.708 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:35.710 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:35.754 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:14:35.788 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.177) 0:02:43.315 ******* 2020-11-20T11:14:35.820 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:35.822 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:35.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.085) 0:02:43.400 ******* 2020-11-20T11:14:35.894 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:35.895 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:35.906 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:14:35.908 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:14:35.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:35 +0000 (0:00:00.070) 0:02:43.470 ******* 2020-11-20T11:14:35.971 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.061) 0:02:43.532 ******* 2020-11-20T11:14:36.015 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:36.064 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:36.077 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.113) 0:02:43.645 ******* 2020-11-20T11:14:36.158 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:36.212 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:14:36.216 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:14:36.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.137) 0:02:43.782 ******* 2020-11-20T11:14:36.322 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:14:36.324 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:14:36.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.101) 0:02:43.884 ******* 2020-11-20T11:14:36.375 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:36.377 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:14:36.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:14:36.389 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.421 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.063) 0:02:43.947 ******* 2020-11-20T11:14:36.427 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:14:36.429 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.477 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.055) 0:02:44.003 ******* 2020-11-20T11:14:36.489 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:14:36.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.071) 0:02:44.075 ******* 2020-11-20T11:14:36.580 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.070) 0:02:44.146 ******* 2020-11-20T11:14:36.653 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi112.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.666 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.691 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi112.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.116) 0:02:44.263 ******* 2020-11-20T11:14:36.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.041) 0:02:44.304 ******* 2020-11-20T11:14:36.796 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:36.798 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.811 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.812 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.813 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:36.816 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.818 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.073) 0:02:44.377 ******* 2020-11-20T11:14:36.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.033) 0:02:44.411 ******* 2020-11-20T11:14:36.892 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:36.893 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:36.941 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:36 +0000 (0:00:00.057) 0:02:44.468 ******* 2020-11-20T11:14:36.979 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:14:36.981 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.071) 0:02:44.539 ******* 2020-11-20T11:14:37.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:14:37.040 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.065) 0:02:44.604 ******* 2020-11-20T11:14:37.107 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.140 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.062) 0:02:44.667 ******* 2020-11-20T11:14:37.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi166.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.065) 0:02:44.733 ******* 2020-11-20T11:14:37.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.032) 0:02:44.765 ******* 2020-11-20T11:14:37.245 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:14:37.249 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.047) 0:02:44.813 ******* 2020-11-20T11:14:37.340 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.104) 0:02:44.917 ******* 2020-11-20T11:14:37.420 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:14:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.072) 0:02:44.990 ******* 2020-11-20T11:14:37.546 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:14:37.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.118) 0:02:45.108 ******* 2020-11-20T11:14:37.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:14:37.615 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.658 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.076) 0:02:45.185 ******* 2020-11-20T11:14:37.685 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:14:37.687 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.720 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.061) 0:02:45.246 ******* 2020-11-20T11:14:37.726 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:14:37.728 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:14:37.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.043) 0:02:45.290 ******* 2020-11-20T11:14:37.770 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:14:37.773 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.816 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.051) 0:02:45.342 ******* 2020-11-20T11:14:37.848 INFO:teuthology.task.ansible.out: 2020-11-20T11:14:37.851 INFO:teuthology.task.ansible.out:TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.070) 0:02:45.413 ******* 2020-11-20T11:14:37.917 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:37.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:37 +0000 (0:00:00.069) 0:02:45.482 ******* 2020-11-20T11:14:37.988 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.018 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.062) 0:02:45.544 ******* 2020-11-20T11:14:38.046 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.062) 0:02:45.606 ******* 2020-11-20T11:14:38.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.065) 0:02:45.672 ******* 2020-11-20T11:14:38.152 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:14:38.189 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.043) 0:02:45.715 ******* 2020-11-20T11:14:38.195 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:14:38.197 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.230 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.041) 0:02:45.757 ******* 2020-11-20T11:14:38.236 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:14:38.239 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.273 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.042) 0:02:45.799 ******* 2020-11-20T11:14:38.279 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.323 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.047) 0:02:45.847 ******* 2020-11-20T11:14:38.328 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.043) 0:02:45.891 ******* 2020-11-20T11:14:38.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.044) 0:02:45.935 ******* 2020-11-20T11:14:38.416 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:14:38.418 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.044) 0:02:45.980 ******* 2020-11-20T11:14:38.480 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:14:38.482 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.515 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.061) 0:02:46.041 ******* 2020-11-20T11:14:38.553 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.589 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.073) 0:02:46.115 ******* 2020-11-20T11:14:38.616 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.061) 0:02:46.177 ******* 2020-11-20T11:14:38.677 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:14:38.678 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.062) 0:02:46.239 ******* 2020-11-20T11:14:38.720 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi112.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.005996", "end": "2020-11-20 11:14:38.651136", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:14:37.645140", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:38.735 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.056) 0:02:46.296 ******* 2020-11-20T11:14:38.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:38.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.067) 0:02:46.363 ******* 2020-11-20T11:14:38.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:14:38.866 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi112.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002954", "end": "2020-11-20 11:14:38.838229", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:14:38.835275", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:38.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.065) 0:02:46.429 ******* 2020-11-20T11:14:38.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.038) 0:02:46.467 ******* 2020-11-20T11:14:38.970 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:39.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:38 +0000 (0:00:00.061) 0:02:46.529 ******* 2020-11-20T11:14:39.041 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:14:39.043 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002785", "end": "2020-11-20 11:14:39.002860", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:14:39.000075", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:39.183 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:10:48 UTC", "ActiveEnterTimestampMonotonic": "15586324", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount systemd-tmpfiles-setup.service ntpd.service ntpdate.service sysinit.target basic.target -.mount system.slice systemd-journald.socket sntp.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:10:46 UTC", "AssertTimestampMonotonic": "14065833", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:10:46 UTC", "ConditionTimestampMonotonic": "14065804", "ConfigurationDirectoryMode": "0755" 2020-11-20T11:14:39.185 INFO:teuthology.task.ansible.out:, "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "888", "ExecMainStartTimestamp": "Fri 2020-11-20 11:10:48 UTC", "ExecMainStartTimestampMonotonic": "15495414", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:46 UTC] ; stop_time=[Fri 2020-11-20 11:10:48 UTC] ; pid=873 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:10:48 UTC] ; stop_time=[Fri 2020-11-20 11:10:48 UTC] ; pid=968 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:10:46 UTC", "InactiveExitTimestampMonotonic": "14100299", "InvocationID": "e5d805ac114b44b89dd69db77cc73fa9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity 2020-11-20T11:14:39.186 INFO:teuthology.task.ansible.out:", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "888", "MemoryAccounting": "yes", "MemoryCurrent": "3248128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualSt 2020-11-20T11:14:39.188 INFO:teuthology.task.ansible.out:art": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:10:48 UTC", "StateChangeTimestampMonotonic": "15586324", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:10:48 UTC", "WatchdogTimestampMonotonic": "15495653", "WatchdogUSec": "0"}} 2020-11-20T11:14:39.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.215) 0:02:46.744 ******* 2020-11-20T11:14:39.235 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi112.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019546", "end": "2020-11-20 11:14:39.195939", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:14:39.176393", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:39.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.052) 0:02:46.797 ******* 2020-11-20T11:14:39.277 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:39.279 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:14:39.311 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.040) 0:02:46.838 ******* 2020-11-20T11:14:39.317 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:14:39.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.045) 0:02:46.883 ******* 2020-11-20T11:14:39.363 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:39.365 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:14:39.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.043) 0:02:46.926 ******* 2020-11-20T11:14:39.427 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:39.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.063) 0:02:46.990 ******* 2020-11-20T11:14:39.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:14:39.472 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:14:39.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.042) 0:02:47.033 ******* 2020-11-20T11:14:39.513 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:14:39.514 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:39.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.043) 0:02:47.077 ******* 2020-11-20T11:14:39.557 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:14:39.559 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:14:39.593 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:39.648 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.097) 0:02:47.174 ******* 2020-11-20T11:14:39.793 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:11:03 UTC", "ActiveEnterTimestampMonotonic": "15207239", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount sntp.service -.mount ntpdate.service ntpd.service systemd-journald.socket sysinit.target basic.target system.slice systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:11:02 UTC", "AssertTimestampMonotonic": "13967614", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:11:02 UTC", "ConditionTimestampMonotonic": "13967574", "ConfigurationDirectoryMode": "0755" 2020-11-20T11:14:39.795 INFO:teuthology.task.ansible.out:, "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "907", "ExecMainStartTimestamp": "Fri 2020-11-20 11:11:03 UTC", "ExecMainStartTimestampMonotonic": "15160891", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:11:02 UTC] ; stop_time=[Fri 2020-11-20 11:11:03 UTC] ; pid=881 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:11:03 UTC] ; stop_time=[Fri 2020-11-20 11:11:03 UTC] ; pid=978 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:11:02 UTC", "InactiveExitTimestampMonotonic": "13977534", "InvocationID": "152030e6a26f4fa884f1e4a7dfb18aa0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity 2020-11-20T11:14:39.798 INFO:teuthology.task.ansible.out:", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "907", "MemoryAccounting": "yes", "MemoryCurrent": "3174400", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualSt 2020-11-20T11:14:39.799 INFO:teuthology.task.ansible.out:art": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:11:03 UTC", "StateChangeTimestampMonotonic": "15207239", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:11:03 UTC", "WatchdogTimestampMonotonic": "15160911", "WatchdogUSec": "0"}} 2020-11-20T11:14:39.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.182) 0:02:47.356 ******* 2020-11-20T11:14:39.836 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:14:39.838 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:14:39.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.040) 0:02:47.397 ******* 2020-11-20T11:14:39.877 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:39.879 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:14:39.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.041) 0:02:47.439 ******* 2020-11-20T11:14:39.950 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:14:39.952 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:14:39.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:39 +0000 (0:00:00.071) 0:02:47.511 ******* 2020-11-20T11:14:40.011 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:14:40.013 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:40.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.061) 0:02:47.572 ******* 2020-11-20T11:14:40.073 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:14:40.076 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:40.111 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.064) 0:02:47.637 ******* 2020-11-20T11:14:40.153 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:40.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.063) 0:02:47.701 ******* 2020-11-20T11:14:40.354 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:14:40.356 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:14:40.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.218) 0:02:47.920 ******* 2020-11-20T11:14:40.400 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:14:40.401 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:14:40.439 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.045) 0:02:47.965 ******* 2020-11-20T11:14:40.925 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:14:40.927 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:14:40.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:40 +0000 (0:00:00.535) 0:02:48.501 ******* 2020-11-20T11:14:41.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:14:41.380 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:14:41.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.438) 0:02:48.939 ******* 2020-11-20T11:14:41.440 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:14:41.442 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:41.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.070) 0:02:49.009 ******* 2020-11-20T11:14:41.513 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:14:41.515 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:14:41.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.063) 0:02:49.073 ******* 2020-11-20T11:14:41.809 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:14:41.814 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:14:41.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.311) 0:02:49.384 ******* 2020-11-20T11:14:41.880 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:14:41.883 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:41.918 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.058) 0:02:49.443 ******* 2020-11-20T11:14:41.944 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:14:41.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:41 +0000 (0:00:00.061) 0:02:49.505 ******* 2020-11-20T11:14:42.005 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:14:42.006 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.041 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.061) 0:02:49.566 ******* 2020-11-20T11:14:42.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.037) 0:02:49.604 ******* 2020-11-20T11:14:42.111 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.158 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.078) 0:02:49.682 ******* 2020-11-20T11:14:42.184 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:14:42.186 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:14:42.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.061) 0:02:49.744 ******* 2020-11-20T11:14:42.241 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:14:42.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.063) 0:02:49.807 ******* 2020-11-20T11:14:42.425 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:14:42.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.189) 0:02:49.997 ******* 2020-11-20T11:14:42.491 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:14:42.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.053) 0:02:50.051 ******* 2020-11-20T11:14:42.533 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.043) 0:02:50.094 ******* 2020-11-20T11:14:42.575 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:14:42.577 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.617 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.048) 0:02:50.143 ******* 2020-11-20T11:14:42.623 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:14:42.626 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:14:42.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.044) 0:02:50.188 ******* 2020-11-20T11:14:42.668 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi166.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.669 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.671 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.673 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.721 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.058) 0:02:50.247 ******* 2020-11-20T11:14:42.729 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.056) 0:02:50.303 ******* 2020-11-20T11:14:42.785 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:14:42.788 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.788 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.800 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.802 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.059) 0:02:50.363 ******* 2020-11-20T11:14:42.878 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.073) 0:02:50.437 ******* 2020-11-20T11:14:42.939 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:42.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:42 +0000 (0:00:00.060) 0:02:50.498 ******* 2020-11-20T11:14:42.978 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:14:42.980 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:14:43.017 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.044) 0:02:50.543 ******* 2020-11-20T11:14:43.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.043) 0:02:50.587 ******* 2020-11-20T11:14:43.089 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:14:43.090 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.123 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.062) 0:02:50.649 ******* 2020-11-20T11:14:43.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:14:43.151 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.185 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.062) 0:02:50.711 ******* 2020-11-20T11:14:43.215 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:14:43.254 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.068) 0:02:50.779 ******* 2020-11-20T11:14:43.260 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.298 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.045) 0:02:50.824 ******* 2020-11-20T11:14:43.305 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:14:43.307 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.049) 0:02:50.874 ******* 2020-11-20T11:14:43.354 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.048) 0:02:50.923 ******* 2020-11-20T11:14:43.404 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:14:43.406 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.406 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.408 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.050) 0:02:50.974 ******* 2020-11-20T11:14:43.454 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:14:43.456 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.051) 0:02:51.025 ******* 2020-11-20T11:14:43.511 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi204.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.513 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.051) 0:02:51.076 ******* 2020-11-20T11:14:43.577 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.063) 0:02:51.140 ******* 2020-11-20T11:14:43.652 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:14:43.654 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.688 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.074) 0:02:51.214 ******* 2020-11-20T11:14:43.715 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.083) 0:02:51.298 ******* 2020-11-20T11:14:43.778 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:14:43.780 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005263", "end": "2020-11-20 11:14:43.685722", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:14:43.680459", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:43.793 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.053) 0:02:51.351 ******* 2020-11-20T11:14:43.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:14:43.853 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.887 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.061) 0:02:51.413 ******* 2020-11-20T11:14:43.903 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:14:43.905 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002985", "end": "2020-11-20 11:14:43.861481", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:14:43.858496", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:43.914 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:14:43.916 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:43.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:43 +0000 (0:00:00.063) 0:02:51.477 ******* 2020-11-20T11:14:43.987 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T11:14:43.990 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:44.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:44 +0000 (0:00:00.079) 0:02:51.556 ******* 2020-11-20T11:14:44.056 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:14:44.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:44 +0000 (0:00:00.061) 0:02:51.617 ******* 2020-11-20T11:14:44.097 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:14:44.099 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002834", "end": "2020-11-20 11:14:44.032934", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:14:44.030100", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:44.249 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022387", "end": "2020-11-20 11:14:44.217549", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:14:44.195162", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:44.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:44 +0000 (0:00:00.194) 0:02:51.811 ******* 2020-11-20T11:14:44.302 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005458", "end": "2020-11-20 11:14:44.262562", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:14:44.257104", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:44.314 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:14:44.347 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:44 +0000 (0:00:00.062) 0:02:51.874 ******* 2020-11-20T11:14:44.534 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:14:44.536 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:14:45.473 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:14:45.475 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.003817", "end": "2020-11-20 11:14:45.436504", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:14:44.432687", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:45.651 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002885", "end": "2020-11-20 11:14:45.618291", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:14:45.615406", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:45.831 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015637", "end": "2020-11-20 11:14:45.796182", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:14:45.780545", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:14:45.864 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:45 +0000 (0:00:01.516) 0:02:53.390 ******* 2020-11-20T11:14:45.897 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:14:45.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:14:45 +0000 (0:00:00.073) 0:02:53.464 ******* 2020-11-20T11:14:46.135 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:14:46.138 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:14:46.242 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T11:14:46.253 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi112.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi166.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi204.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 Friday 20 November 2020 11:14:46 +0000 (0:00:00.315) 0:02:53.779 ******* =============================================================================== 2020-11-20T11:14:46.256 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 12.00s common : nrpe - Load SELinux policy package ---------------------------- 11.98s common : Register with subscription-manager. --------------------------- 10.42s testnode : Install packages --------------------------------------------- 2.69s testnode : Make sure rpm dependencies are installed --------------------- 2.39s testnode : Ensure ceph packages are not present. ------------------------ 2.07s testnode : Rebuild rpmdb ------------------------------------------------ 1.95s common : nrpe - Ensure SELinux policy is up to date --------------------- 1.74s testnode : Zap all non-root disks --------------------------------------- 1.70s testnode : Ensure ceph dependency packages are not present. ------------- 1.59s Gathering Facts --------------------------------------------------------- 1.46s common : Get list of enabled RHSM repos --------------------------------- 1.20s common : Install Kerberos Packages (RedHat) ----------------------------- 1.04s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.85s common : List CDN releases available to system -------------------------- 0.80s testnode : Install epel packages ---------------------------------------- 0.80s ansible-managed : Add authorized keys for the ansible user. ------------- 0.79s common : Install CA Cert from Satellite Server -------------------------- 0.73s Gathering Facts --------------------------------------------------------- 0.64s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.60s 2020-11-20T11:14:46.577 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi166.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2020-11-20T11:14:46.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:14:46.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:14:46.653 INFO:teuthology.orchestra.run.smithi112:> true 2020-11-20T11:14:46.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:14:46.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:14:46.821 INFO:teuthology.orchestra.run.smithi166:> true 2020-11-20T11:14:46.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:14:46.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:14:46.989 INFO:teuthology.orchestra.run.smithi204:> true 2020-11-20T11:14:47.086 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T11:14:47.096 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T11:14:47.097 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:14:47.097 INFO:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:14:47.134 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:14:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:14:47.188 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2020-11-20T11:14:47.200 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2020-11-20T11:14:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:14:47.227 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:14:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2020-11-20T11:14:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:210 Number of sources = 4 2020-11-20T11:14:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:14:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2020-11-20T11:14:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.290 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:14:47.291 INFO:teuthology.orchestra.run.smithi166:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:14:47.357 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:14:47.373 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:14:47.411 INFO:teuthology.orchestra.run.smithi166.stderr:sudo: ntpd: command not found 2020-11-20T11:14:47.421 INFO:teuthology.orchestra.run.smithi166.stdout:506 Cannot talk to daemon 2020-11-20T11:14:47.436 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:14:47.450 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:14:47.507 INFO:teuthology.orchestra.run.smithi166.stderr:bash: ntpq: command not found 2020-11-20T11:14:47.510 INFO:teuthology.orchestra.run.smithi166.stdout:210 Number of sources = 4 2020-11-20T11:14:47.510 INFO:teuthology.orchestra.run.smithi166.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:14:47.510 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================== 2020-11-20T11:14:47.511 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.511 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.511 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.511 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.512 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:14:47.512 INFO:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:14:47.553 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:14:47.568 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:14:47.604 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2020-11-20T11:14:47.616 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2020-11-20T11:14:47.630 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:14:47.644 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:14:47.697 INFO:teuthology.orchestra.run.smithi204.stderr:bash: ntpq: command not found 2020-11-20T11:14:47.700 INFO:teuthology.orchestra.run.smithi204.stdout:210 Number of sources = 4 2020-11-20T11:14:47.700 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:14:47.701 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2020-11-20T11:14:47.701 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.701 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.702 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.702 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:14:47.702 INFO:teuthology.run_tasks:Running task install... 2020-11-20T11:14:47.724 DEBUG:teuthology.task.install:project ceph 2020-11-20T11:14:47.727 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T11:14:47.728 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T11:14:47.728 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T11:14:47.735 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T11:14:47.735 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T11:14:47.736 INFO:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2020-11-20T11:14:47.778 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2020-11-20T11:14:47.779 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.780 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-20T11:14:47.780 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:14:47.781 INFO:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2020-11-20T11:14:47.820 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-20T11:14:47.821 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.822 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-11-20T11:14:47.823 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:14:47.823 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-20T11:14:47.859 INFO:teuthology.orchestra.run.smithi204.stdout:RedHatEnterprise 2020-11-20T11:14:47.861 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.863 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:14:47.864 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-11-20T11:14:47.870 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2020-11-20T11:14:47.870 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:14:47.908 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-20T11:14:47.909 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:14:47.937 INFO:teuthology.orchestra.run.smithi204.stdout:RedHatEnterprise 2020-11-20T11:14:47.944 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:14:47.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:14:48.039 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:14:48.039 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:14:48.082 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:14:48.082 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:14:48.102 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:14:48.103 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:14:48.188 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:14:48.189 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:14:48.189 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.218 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:14:48.219 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:14:48.219 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.221 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2020-11-20T11:14:48.221 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2020-11-20T11:14:48.221 INFO:teuthology.orchestra.run.smithi112.stderr:676 bytes copied, 4.871e-05 s, 13.9 MB/s 2020-11-20T11:14:48.222 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:14:48.223 INFO:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:14:48.239 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:14:48.240 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:14:48.240 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.241 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.246 INFO:teuthology.orchestra.run.smithi166.stderr:1+1 records in 2020-11-20T11:14:48.246 INFO:teuthology.orchestra.run.smithi166.stderr:1+1 records out 2020-11-20T11:14:48.247 INFO:teuthology.orchestra.run.smithi166.stderr:676 bytes copied, 3.8673e-05 s, 17.5 MB/s 2020-11-20T11:14:48.248 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:14:48.248 INFO:teuthology.orchestra.run.smithi166:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:14:48.260 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:14:48.270 INFO:teuthology.orchestra.run.smithi204.stderr:1+1 records in 2020-11-20T11:14:48.271 INFO:teuthology.orchestra.run.smithi204.stderr:1+1 records out 2020-11-20T11:14:48.271 INFO:teuthology.orchestra.run.smithi204.stderr:676 bytes copied, 4.2377e-05 s, 16.0 MB/s 2020-11-20T11:14:48.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:14:48.272 INFO:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:14:48.300 INFO:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:14:48.317 INFO:teuthology.orchestra.run.smithi166:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:14:48.346 INFO:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:14:48.389 INFO:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:14:48.397 INFO:teuthology.orchestra.run.smithi166:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:14:48.425 INFO:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:14:48.462 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2020-11-20T11:14:48.462 INFO:teuthology.orchestra.run.smithi112:> sudo yum clean all 2020-11-20T11:14:48.465 INFO:teuthology.orchestra.run.smithi166.stdout:check_obsoletes = 1 2020-11-20T11:14:48.466 INFO:teuthology.orchestra.run.smithi166:> sudo yum clean all 2020-11-20T11:14:48.493 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2020-11-20T11:14:48.495 INFO:teuthology.orchestra.run.smithi204:> sudo yum clean all 2020-11-20T11:14:48.778 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:48.825 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:48.850 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:49.085 INFO:teuthology.orchestra.run.smithi112.stdout:38 files removed 2020-11-20T11:14:49.108 INFO:teuthology.orchestra.run.smithi166.stdout:38 files removed 2020-11-20T11:14:49.121 INFO:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:14:49.130 INFO:teuthology.orchestra.run.smithi204.stdout:38 files removed 2020-11-20T11:14:49.149 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:14:49.166 INFO:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:14:49.388 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:49.420 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:49.430 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2020-11-20T11:14:50.057 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 291 kB/s | 72 kB 00:00 2020-11-20T11:14:50.058 INFO:teuthology.orchestra.run.smithi166.stdout:ceph packages for x86_64 292 kB/s | 72 kB 00:00 2020-11-20T11:14:50.210 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 290 kB/s | 72 kB 00:00 2020-11-20T11:14:50.292 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 72 kB/s | 15 kB 00:00 2020-11-20T11:14:50.293 INFO:teuthology.orchestra.run.smithi166.stdout:ceph noarch packages 72 kB/s | 15 kB 00:00 2020-11-20T11:14:50.448 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 71 kB/s | 15 kB 00:00 2020-11-20T11:14:50.517 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:14:50.518 INFO:teuthology.orchestra.run.smithi166.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:14:50.673 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:14:50.855 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:14:50.863 INFO:teuthology.orchestra.run.smithi166.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:14:51.118 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 20 MB/s | 8.3 MB 00:00 2020-11-20T11:14:52.494 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 4.8 MB/s | 23 kB 00:00 2020-11-20T11:14:52.516 INFO:teuthology.orchestra.run.smithi166.stdout:lab-extras 5.1 MB/s | 23 kB 00:00 2020-11-20T11:14:52.771 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 4.4 MB/s | 23 kB 00:00 2020-11-20T11:14:52.773 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 109 MB/s | 25 MB 00:00 2020-11-20T11:14:52.842 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 87 MB/s | 24 MB 00:00 2020-11-20T11:14:53.042 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 110 MB/s | 24 MB 00:00 2020-11-20T11:14:56.407 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 MB/s | 24 MB 00:00 2020-11-20T11:14:56.510 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 114 MB/s | 25 MB 00:00 2020-11-20T11:14:56.755 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 118 MB/s | 25 MB 00:00 2020-11-20T11:15:01.938 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:01.938 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:01.945 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:15:01.946 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:15:01.947 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:15:01.947 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:15:01.948 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:15:01.950 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:15:01.951 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:15:02.076 INFO:teuthology.orchestra.run.smithi166.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:02.076 INFO:teuthology.orchestra.run.smithi166.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:02.083 INFO:teuthology.orchestra.run.smithi166.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:15:02.083 INFO:teuthology.orchestra.run.smithi166.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:15:02.084 INFO:teuthology.orchestra.run.smithi166.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:15:02.085 INFO:teuthology.orchestra.run.smithi166.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:15:02.086 INFO:teuthology.orchestra.run.smithi166.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:15:02.088 INFO:teuthology.orchestra.run.smithi166.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:15:02.089 INFO:teuthology.orchestra.run.smithi166.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:15:02.247 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:02.247 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:15:02.254 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:15:02.255 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:15:02.256 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:15:02.256 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:15:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:15:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:15:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:15:02.265 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2020-11-20T11:15:02.285 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================================== 2020-11-20T11:15:02.286 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2020-11-20T11:15:02.286 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================================== 2020-11-20T11:15:02.287 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2020-11-20T11:15:02.287 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:15:02.287 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:15:02.287 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:15:02.288 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:15:02.288 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.288 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:15:02.289 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:15:02.289 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:15:02.289 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:15:02.290 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:15:02.290 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:15:02.290 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:15:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:15:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:15:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:15:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:15:02.292 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:15:02.292 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:15:02.292 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:15:02.293 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:15:02.293 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:15:02.293 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:15:02.293 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.294 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:15:02.294 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:15:02.294 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:15:02.294 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:15:02.295 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:15:02.295 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:15:02.295 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:15:02.295 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2020-11-20T11:15:02.296 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:15:02.296 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:15:02.296 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:15:02.296 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:15:02.297 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.297 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:15:02.297 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2020-11-20T11:15:02.297 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:15:02.298 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:15:02.298 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:15:02.298 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:15:02.298 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:15:02.299 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:15:02.299 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:15:02.299 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:15:02.299 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:15:02.300 INFO:teuthology.orchestra.run.smithi204.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:15:02.300 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:15:02.300 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:15:02.300 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:15:02.300 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:15:02.301 INFO:teuthology.orchestra.run.smithi204.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:15:02.301 INFO:teuthology.orchestra.run.smithi204.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:15:02.301 INFO:teuthology.orchestra.run.smithi204.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:15:02.301 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:15:02.301 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:15:02.302 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:15:02.302 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:15:02.302 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:15:02.302 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:15:02.302 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:15:02.303 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.303 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:15:02.303 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:15:02.303 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:15:02.303 INFO:teuthology.orchestra.run.smithi204.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:15:02.304 INFO:teuthology.orchestra.run.smithi204.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:15:02.304 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:15:02.304 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:15:02.304 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:15:02.305 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:15:02.305 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:15:02.305 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:15:02.305 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:15:02.306 INFO:teuthology.orchestra.run.smithi204.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:15:02.306 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:15:02.306 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:15:02.306 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:15:02.306 INFO:teuthology.orchestra.run.smithi204.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:15:02.307 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:15:02.307 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:15:02.307 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:15:02.307 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:15:02.308 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:15:02.308 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:15:02.308 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:15:02.308 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:15:02.309 INFO:teuthology.orchestra.run.smithi204.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:15:02.309 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:15:02.309 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:15:02.309 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:15:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:15:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:15:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:15:02.311 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:15:02.311 INFO:teuthology.orchestra.run.smithi204.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:15:02.311 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:15:02.311 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:15:02.312 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:15:02.312 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:15:02.312 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:15:02.312 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:15:02.312 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:15:02.313 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:15:02.313 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:15:02.313 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:15:02.313 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:15:02.313 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:15:02.314 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:15:02.314 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:15:02.314 INFO:teuthology.orchestra.run.smithi204.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:15:02.314 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:15:02.315 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.315 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:15:02.315 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:15:02.315 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:15:02.315 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:15:02.316 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:15:02.316 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:15:02.316 INFO:teuthology.orchestra.run.smithi204.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:15:02.316 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:15:02.317 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.317 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:15:02.317 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:15:02.317 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:15:02.317 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:15:02.318 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:15:02.318 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:15:02.318 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:15:02.318 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:15:02.318 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2020-11-20T11:15:02.319 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:15:02.319 INFO:teuthology.orchestra.run.smithi204.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:15:02.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:15:02.319 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2020-11-20T11:15:02.319 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================================== 2020-11-20T11:15:02.320 INFO:teuthology.orchestra.run.smithi204.stdout:Install 127 Packages 2020-11-20T11:15:02.320 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 6 Packages 2020-11-20T11:15:02.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:15:02.321 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 199 M 2020-11-20T11:15:02.321 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2020-11-20T11:15:02.401 INFO:teuthology.orchestra.run.smithi204.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 64 kB/s | 6.4 kB 00:00 2020-11-20T11:15:02.404 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-20T11:15:02.434 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-20T11:15:02.434 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-20T11:15:02.434 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-20T11:15:02.434 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-20T11:15:02.435 INFO:teuthology.orchestra.run.smithi166.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:15:02.435 INFO:teuthology.orchestra.run.smithi166.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:15:02.435 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:15:02.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:15:02.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:15:02.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:15:02.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:15:02.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:15:02.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:15:02.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:15:02.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:15:02.438 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:15:02.438 INFO:teuthology.orchestra.run.smithi166.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:15:02.438 INFO:teuthology.orchestra.run.smithi166.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:15:02.438 INFO:teuthology.orchestra.run.smithi166.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:15:02.438 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:15:02.439 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:15:02.439 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:15:02.439 INFO:teuthology.orchestra.run.smithi166.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:15:02.439 INFO:teuthology.orchestra.run.smithi166.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:15:02.440 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:15:02.440 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.440 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:15:02.440 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:15:02.440 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:15:02.441 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:15:02.441 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:15:02.441 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:15:02.441 INFO:teuthology.orchestra.run.smithi166.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:15:02.441 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrading: 2020-11-20T11:15:02.442 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:15:02.442 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:15:02.443 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:15:02.443 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:15:02.443 INFO:teuthology.orchestra.run.smithi166.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.443 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:15:02.443 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-20T11:15:02.444 INFO:teuthology.orchestra.run.smithi166.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:15:02.444 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:15:02.444 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:15:02.444 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:15:02.444 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:15:02.445 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:15:02.445 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:15:02.445 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:15:02.445 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:15:02.446 INFO:teuthology.orchestra.run.smithi166.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:15:02.446 INFO:teuthology.orchestra.run.smithi166.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:15:02.446 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:15:02.446 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:15:02.446 INFO:teuthology.orchestra.run.smithi166.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:15:02.447 INFO:teuthology.orchestra.run.smithi166.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:15:02.447 INFO:teuthology.orchestra.run.smithi166.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:15:02.447 INFO:teuthology.orchestra.run.smithi166.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:15:02.447 INFO:teuthology.orchestra.run.smithi166.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:15:02.447 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:15:02.448 INFO:teuthology.orchestra.run.smithi166.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:15:02.448 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:15:02.448 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:15:02.448 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:15:02.448 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:15:02.449 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.449 INFO:teuthology.orchestra.run.smithi166.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:15:02.449 INFO:teuthology.orchestra.run.smithi166.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:15:02.449 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:15:02.449 INFO:teuthology.orchestra.run.smithi166.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:15:02.450 INFO:teuthology.orchestra.run.smithi166.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:15:02.450 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:15:02.450 INFO:teuthology.orchestra.run.smithi166.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:15:02.450 INFO:teuthology.orchestra.run.smithi166.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:15:02.451 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:15:02.451 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:15:02.451 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:15:02.451 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:15:02.451 INFO:teuthology.orchestra.run.smithi166.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:15:02.452 INFO:teuthology.orchestra.run.smithi166.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:15:02.452 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:15:02.452 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:15:02.452 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:15:02.452 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:15:02.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:15:02.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:15:02.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:15:02.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:15:02.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:15:02.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:15:02.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:15:02.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:15:02.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:15:02.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:15:02.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:15:02.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:15:02.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:15:02.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:15:02.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:15:02.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:15:02.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:15:02.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:15:02.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:15:02.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:15:02.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:15:02.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:15:02.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:15:02.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:15:02.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:15:02.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:15:02.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:15:02.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:15:02.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:15:02.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:15:02.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:15:02.460 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:15:02.460 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.460 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:15:02.460 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:15:02.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:15:02.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:15:02.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:15:02.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:15:02.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:15:02.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:15:02.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:15:02.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:15:02.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:15:02.463 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:15:02.463 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:15:02.463 INFO:teuthology.orchestra.run.smithi166.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:15:02.463 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:15:02.463 INFO:teuthology.orchestra.run.smithi166.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:15:02.464 INFO:teuthology.orchestra.run.smithi166.stdout:Installing weak dependencies: 2020-11-20T11:15:02.464 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:15:02.464 INFO:teuthology.orchestra.run.smithi166.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:15:02.464 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:15:02.464 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-20T11:15:02.465 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-20T11:15:02.465 INFO:teuthology.orchestra.run.smithi166.stdout:Install 127 Packages 2020-11-20T11:15:02.465 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrade 6 Packages 2020-11-20T11:15:02.465 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:15:02.466 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 199 M 2020-11-20T11:15:02.466 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-20T11:15:02.549 INFO:teuthology.orchestra.run.smithi166.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 64 kB/s | 6.4 kB 00:00 2020-11-20T11:15:02.563 INFO:teuthology.orchestra.run.smithi204.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 3.8 MB/s | 632 kB 00:00 2020-11-20T11:15:02.573 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2020-11-20T11:15:02.593 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2020-11-20T11:15:02.593 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2020-11-20T11:15:02.593 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2020-11-20T11:15:02.594 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2020-11-20T11:15:02.594 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:15:02.594 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:15:02.594 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:15:02.595 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:15:02.595 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.595 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:15:02.595 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:15:02.596 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:15:02.596 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:15:02.596 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:15:02.596 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:15:02.597 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:15:02.597 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:15:02.597 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:15:02.597 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:15:02.598 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:15:02.598 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:15:02.598 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:15:02.599 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:15:02.599 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:15:02.599 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:15:02.600 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:15:02.600 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:15:02.600 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:15:02.600 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:15:02.601 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:15:02.602 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:15:02.602 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:15:02.603 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:15:02.603 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:15:02.603 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2020-11-20T11:15:02.603 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:15:02.604 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:15:02.604 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:15:02.604 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:15:02.605 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.605 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:15:02.605 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2020-11-20T11:15:02.606 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:15:02.606 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:15:02.606 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:15:02.607 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:15:02.607 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:15:02.607 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:15:02.607 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:15:02.608 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:15:02.608 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:15:02.608 INFO:teuthology.orchestra.run.smithi112.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:15:02.608 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:15:02.609 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:15:02.609 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:15:02.610 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:15:02.610 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:15:02.610 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:15:02.610 INFO:teuthology.orchestra.run.smithi112.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:15:02.611 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:15:02.611 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:15:02.611 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:15:02.612 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:15:02.612 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:15:02.612 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:15:02.613 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:15:02.613 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:15:02.613 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:15:02.614 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:15:02.614 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:15:02.615 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:15:02.615 INFO:teuthology.orchestra.run.smithi112.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:15:02.615 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:15:02.616 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:15:02.616 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:15:02.617 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:15:02.617 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:15:02.617 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:15:02.618 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:15:02.618 INFO:teuthology.orchestra.run.smithi112.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:15:02.619 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:15:02.619 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:15:02.619 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:15:02.620 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:15:02.620 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:15:02.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:15:02.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:15:02.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:15:02.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:15:02.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:15:02.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:15:02.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:15:02.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:15:02.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:15:02.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:15:02.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:15:02.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:15:02.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:15:02.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:15:02.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:15:02.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:15:02.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:15:02.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:15:02.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:15:02.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:15:02.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:15:02.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:15:02.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:15:02.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:15:02.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:15:02.631 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:15:02.631 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:15:02.631 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:15:02.631 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:15:02.631 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:15:02.632 INFO:teuthology.orchestra.run.smithi112.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:15:02.632 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:15:02.632 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:15:02.632 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:15:02.632 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:15:02.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:15:02.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:15:02.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:15:02.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:15:02.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:15:02.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:15:02.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:15:02.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:15:02.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:15:02.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:15:02.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:15:02.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:15:02.637 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:15:02.638 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:15:02.638 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:15:02.638 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2020-11-20T11:15:02.639 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:15:02.639 INFO:teuthology.orchestra.run.smithi112.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:15:02.640 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:15:02.640 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2020-11-20T11:15:02.640 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2020-11-20T11:15:02.641 INFO:teuthology.orchestra.run.smithi112.stdout:Install 127 Packages 2020-11-20T11:15:02.641 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 6 Packages 2020-11-20T11:15:02.642 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:15:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 4.3 MB/s | 204 kB 00:00 2020-11-20T11:15:02.643 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 199 M 2020-11-20T11:15:02.643 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2020-11-20T11:15:02.760 INFO:teuthology.orchestra.run.smithi112.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2020-11-20T11:15:02.771 INFO:teuthology.orchestra.run.smithi166.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 2.8 MB/s | 632 kB 00:00 2020-11-20T11:15:02.864 INFO:teuthology.orchestra.run.smithi166.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 2.1 MB/s | 204 kB 00:00 2020-11-20T11:15:03.065 INFO:teuthology.orchestra.run.smithi204.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 4.7 MB/s | 2.1 MB 00:00 2020-11-20T11:15:03.297 INFO:teuthology.orchestra.run.smithi112.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 1.2 MB/s | 632 kB 00:00 2020-11-20T11:15:03.439 INFO:teuthology.orchestra.run.smithi204.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 4.1 MB/s | 1.5 MB 00:00 2020-11-20T11:15:03.455 INFO:teuthology.orchestra.run.smithi112.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 1.3 MB/s | 204 kB 00:00 2020-11-20T11:15:03.519 INFO:teuthology.orchestra.run.smithi204.stdout:(6/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 4.9 MB/s | 6.0 MB 00:01 2020-11-20T11:15:03.556 INFO:teuthology.orchestra.run.smithi166.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 3.1 MB/s | 2.1 MB 00:00 2020-11-20T11:15:04.131 INFO:teuthology.orchestra.run.smithi166.stdout:(5/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 3.5 MB/s | 6.0 MB 00:01 2020-11-20T11:15:04.467 INFO:teuthology.orchestra.run.smithi166.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 1.7 MB/s | 1.5 MB 00:00 2020-11-20T11:15:04.487 INFO:teuthology.orchestra.run.smithi204.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 4.7 MB/s | 5.0 MB 00:01 2020-11-20T11:15:05.065 INFO:teuthology.orchestra.run.smithi112.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.3 MB/s | 2.1 MB 00:01 2020-11-20T11:15:05.508 INFO:teuthology.orchestra.run.smithi166.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 3.6 MB/s | 5.0 MB 00:01 2020-11-20T11:15:06.222 INFO:teuthology.orchestra.run.smithi112.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 1.3 MB/s | 1.5 MB 00:01 2020-11-20T11:15:06.545 INFO:teuthology.orchestra.run.smithi112.stdout:(6/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 1.5 MB/s | 6.0 MB 00:03 2020-11-20T11:15:07.043 INFO:teuthology.orchestra.run.smithi204.stdout:(8/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x86 5.1 MB/s | 18 MB 00:03 2020-11-20T11:15:07.234 INFO:teuthology.orchestra.run.smithi204.stdout:(9/133): ceph-common-16.0.0-7397.gb86e691b.el8. 4.7 MB/s | 23 MB 00:04 2020-11-20T11:15:07.234 INFO:teuthology.orchestra.run.smithi204.stdout:(10/133): ceph-selinux-16.0.0-7397.gb86e691b.el 130 kB/s | 25 kB 00:00 2020-11-20T11:15:07.306 INFO:teuthology.orchestra.run.smithi204.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 334 kB/s | 24 kB 00:00 2020-11-20T11:15:07.460 INFO:teuthology.orchestra.run.smithi204.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.6 MB/s | 562 kB 00:00 2020-11-20T11:15:07.533 INFO:teuthology.orchestra.run.smithi204.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 1.8 MB/s | 131 kB 00:00 2020-11-20T11:15:07.595 INFO:teuthology.orchestra.run.smithi204.stdout:(14/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 3.8 MB/s | 12 MB 00:03 2020-11-20T11:15:07.656 INFO:teuthology.orchestra.run.smithi204.stdout:(15/133): libradosstriper1-16.0.0-7397.gb86e691 3.8 MB/s | 486 kB 00:00 2020-11-20T11:15:07.722 INFO:teuthology.orchestra.run.smithi204.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 606 kB/s | 40 kB 00:00 2020-11-20T11:15:07.789 INFO:teuthology.orchestra.run.smithi204.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.1 MB/s | 73 kB 00:00 2020-11-20T11:15:07.862 INFO:teuthology.orchestra.run.smithi204.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.8 MB/s | 204 kB 00:00 2020-11-20T11:15:07.940 INFO:teuthology.orchestra.run.smithi204.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 4.7 MB/s | 375 kB 00:00 2020-11-20T11:15:08.020 INFO:teuthology.orchestra.run.smithi204.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.3 MB/s | 353 kB 00:00 2020-11-20T11:15:08.079 INFO:teuthology.orchestra.run.smithi204.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.9 MB/s | 113 kB 00:00 2020-11-20T11:15:08.136 INFO:teuthology.orchestra.run.smithi204.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.5 MB/s | 88 kB 00:00 2020-11-20T11:15:08.216 INFO:teuthology.orchestra.run.smithi166.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 4.0 MB/s | 23 MB 00:05 2020-11-20T11:15:08.250 INFO:teuthology.orchestra.run.smithi166.stdout:(9/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 4.3 MB/s | 12 MB 00:02 2020-11-20T11:15:08.278 INFO:teuthology.orchestra.run.smithi166.stdout:(10/133): ceph-selinux-16.0.0-7397.gb86e691b.el 407 kB/s | 25 kB 00:00 2020-11-20T11:15:08.348 INFO:teuthology.orchestra.run.smithi166.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 337 kB/s | 24 kB 00:00 2020-11-20T11:15:08.448 INFO:teuthology.orchestra.run.smithi204.stdout:(23/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.3 MB/s | 3.7 MB 00:00 2020-11-20T11:15:08.497 INFO:teuthology.orchestra.run.smithi166.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.7 MB/s | 562 kB 00:00 2020-11-20T11:15:08.521 INFO:teuthology.orchestra.run.smithi204.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.3 MB/s | 171 kB 00:00 2020-11-20T11:15:08.567 INFO:teuthology.orchestra.run.smithi166.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 1.8 MB/s | 131 kB 00:00 2020-11-20T11:15:08.585 INFO:teuthology.orchestra.run.smithi204.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 372 kB/s | 24 kB 00:00 2020-11-20T11:15:08.609 INFO:teuthology.orchestra.run.smithi204.stdout:(26/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 6.7 MB/s | 3.2 MB 00:00 2020-11-20T11:15:08.648 INFO:teuthology.orchestra.run.smithi204.stdout:(27/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.0 MB/s | 66 kB 00:00 2020-11-20T11:15:08.706 INFO:teuthology.orchestra.run.smithi166.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 3.4 MB/s | 486 kB 00:00 2020-11-20T11:15:09.168 INFO:teuthology.orchestra.run.smithi204.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 5.7 MB/s | 3.2 MB 00:00 2020-11-20T11:15:09.237 INFO:teuthology.orchestra.run.smithi204.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 2.8 MB/s | 198 kB 00:00 2020-11-20T11:15:09.298 INFO:teuthology.orchestra.run.smithi204.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 447 kB/s | 27 kB 00:00 2020-11-20T11:15:09.357 INFO:teuthology.orchestra.run.smithi204.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 149 kB/s | 8.8 kB 00:00 2020-11-20T11:15:09.419 INFO:teuthology.orchestra.run.smithi204.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 934 kB/s | 57 kB 00:00 2020-11-20T11:15:09.447 INFO:teuthology.orchestra.run.smithi112.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 1.5 MB/s | 5.0 MB 00:03 2020-11-20T11:15:09.500 INFO:teuthology.orchestra.run.smithi204.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T11:15:09.534 INFO:teuthology.orchestra.run.smithi204.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 9.1 MB/s | 315 kB 00:00 2020-11-20T11:15:09.552 INFO:teuthology.orchestra.run.smithi204.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T11:15:09.569 INFO:teuthology.orchestra.run.smithi204.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T11:15:09.585 INFO:teuthology.orchestra.run.smithi204.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T11:15:09.602 INFO:teuthology.orchestra.run.smithi204.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T11:15:09.611 INFO:teuthology.orchestra.run.smithi166.stdout:(15/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.1 MB/s | 3.7 MB 00:00 2020-11-20T11:15:09.619 INFO:teuthology.orchestra.run.smithi204.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.6 MB/s | 44 kB 00:00 2020-11-20T11:15:09.636 INFO:teuthology.orchestra.run.smithi204.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 10 MB/s | 185 kB 00:00 2020-11-20T11:15:09.653 INFO:teuthology.orchestra.run.smithi204.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 2.0 MB/s | 33 kB 00:00 2020-11-20T11:15:09.664 INFO:teuthology.orchestra.run.smithi166.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 750 kB/s | 40 kB 00:00 2020-11-20T11:15:09.669 INFO:teuthology.orchestra.run.smithi204.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 1.0 MB/s | 16 kB 00:00 2020-11-20T11:15:09.686 INFO:teuthology.orchestra.run.smithi204.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 8.3 MB/s | 145 kB 00:00 2020-11-20T11:15:09.719 INFO:teuthology.orchestra.run.smithi204.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 12 MB/s | 384 kB 00:00 2020-11-20T11:15:09.719 INFO:teuthology.orchestra.run.smithi166.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.3 MB/s | 73 kB 00:00 2020-11-20T11:15:09.735 INFO:teuthology.orchestra.run.smithi204.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.4 MB/s | 40 kB 00:00 2020-11-20T11:15:09.754 INFO:teuthology.orchestra.run.smithi204.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 19 MB/s | 355 kB 00:00 2020-11-20T11:15:09.771 INFO:teuthology.orchestra.run.smithi204.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 4.7 MB/s | 81 kB 00:00 2020-11-20T11:15:09.779 INFO:teuthology.orchestra.run.smithi166.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 3.3 MB/s | 204 kB 00:00 2020-11-20T11:15:09.787 INFO:teuthology.orchestra.run.smithi204.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 679 kB/s | 11 kB 00:00 2020-11-20T11:15:09.804 INFO:teuthology.orchestra.run.smithi204.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 1.1 MB/s | 18 kB 00:00 2020-11-20T11:15:09.856 INFO:teuthology.orchestra.run.smithi204.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 23 MB/s | 1.2 MB 00:00 2020-11-20T11:15:09.872 INFO:teuthology.orchestra.run.smithi204.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.9 MB/s | 49 kB 00:00 2020-11-20T11:15:09.889 INFO:teuthology.orchestra.run.smithi204.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 3.4 MB/s | 59 kB 00:00 2020-11-20T11:15:09.897 INFO:teuthology.orchestra.run.smithi166.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 3.1 MB/s | 375 kB 00:00 2020-11-20T11:15:09.908 INFO:teuthology.orchestra.run.smithi204.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-11-20T11:15:09.924 INFO:teuthology.orchestra.run.smithi204.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 967 kB/s | 16 kB 00:00 2020-11-20T11:15:09.941 INFO:teuthology.orchestra.run.smithi204.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.8 MB/s | 48 kB 00:00 2020-11-20T11:15:09.958 INFO:teuthology.orchestra.run.smithi204.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T11:15:09.975 INFO:teuthology.orchestra.run.smithi204.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T11:15:09.992 INFO:teuthology.orchestra.run.smithi204.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-20T11:15:10.008 INFO:teuthology.orchestra.run.smithi204.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T11:15:10.015 INFO:teuthology.orchestra.run.smithi166.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 2.9 MB/s | 353 kB 00:00 2020-11-20T11:15:10.025 INFO:teuthology.orchestra.run.smithi204.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2020-11-20T11:15:10.041 INFO:teuthology.orchestra.run.smithi204.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2020-11-20T11:15:10.058 INFO:teuthology.orchestra.run.smithi204.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.7 MB/s | 27 kB 00:00 2020-11-20T11:15:10.073 INFO:teuthology.orchestra.run.smithi166.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.9 MB/s | 113 kB 00:00 2020-11-20T11:15:10.076 INFO:teuthology.orchestra.run.smithi204.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-11-20T11:15:10.094 INFO:teuthology.orchestra.run.smithi204.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 14 MB/s | 251 kB 00:00 2020-11-20T11:15:10.111 INFO:teuthology.orchestra.run.smithi204.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.6 MB/s | 61 kB 00:00 2020-11-20T11:15:10.128 INFO:teuthology.orchestra.run.smithi204.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 5.0 MB/s | 85 kB 00:00 2020-11-20T11:15:10.129 INFO:teuthology.orchestra.run.smithi166.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.5 MB/s | 88 kB 00:00 2020-11-20T11:15:10.144 INFO:teuthology.orchestra.run.smithi204.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T11:15:10.161 INFO:teuthology.orchestra.run.smithi204.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.1 MB/s | 69 kB 00:00 2020-11-20T11:15:10.196 INFO:teuthology.orchestra.run.smithi204.stdout:(69/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.6 MB/s | 238 kB 00:00 2020-11-20T11:15:10.217 INFO:teuthology.orchestra.run.smithi204.stdout:(70/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 861 kB/s | 18 kB 00:00 2020-11-20T11:15:10.239 INFO:teuthology.orchestra.run.smithi204.stdout:(71/133): python3-asn1crypto-0.24.0-3.el8.noarc 8.3 MB/s | 181 kB 00:00 2020-11-20T11:15:10.259 INFO:teuthology.orchestra.run.smithi204.stdout:(72/133): python3-requests-oauthlib-1.0.0-1.el8 2.1 MB/s | 43 kB 00:00 2020-11-20T11:15:10.278 INFO:teuthology.orchestra.run.smithi204.stdout:(73/133): fuse-2.9.7-12.el8.x86_64.rpm 4.3 MB/s | 83 kB 00:00 2020-11-20T11:15:10.812 INFO:teuthology.orchestra.run.smithi204.stdout:(74/133): python3-pycparser-2.14-14.el8.noarch. 5.3 MB/s | 109 kB 00:00 2020-11-20T11:15:10.812 INFO:teuthology.orchestra.run.smithi204.stdout:(75/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.4 MB/s | 48 kB 00:00 2020-11-20T11:15:10.812 INFO:teuthology.orchestra.run.smithi204.stdout:(76/133): python3-jwt-1.6.1-2.el8.noarch.rpm 2.0 MB/s | 43 kB 00:00 2020-11-20T11:15:10.813 INFO:teuthology.orchestra.run.smithi204.stdout:(77/133): python3-oauthlib-2.1.0-1.el8.noarch.r 7.4 MB/s | 155 kB 00:00 2020-11-20T11:15:10.813 INFO:teuthology.orchestra.run.smithi204.stdout:(78/133): fuse-common-3.2.1-12.el8.x86_64.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:15:10.813 INFO:teuthology.orchestra.run.smithi204.stdout:(79/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2020-11-20T11:15:10.813 INFO:teuthology.orchestra.run.smithi204.stdout:(80/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 949 kB/s | 19 kB 00:00 2020-11-20T11:15:10.813 INFO:teuthology.orchestra.run.smithi204.stdout:(81/133): libselinux-devel-2.9-3.el8.x86_64.rpm 9.5 MB/s | 199 kB 00:00 2020-11-20T11:15:10.814 INFO:teuthology.orchestra.run.smithi204.stdout:(82/133): python3-cryptography-2.3-3.el8.x86_64 22 MB/s | 511 kB 00:00 2020-11-20T11:15:10.814 INFO:teuthology.orchestra.run.smithi204.stdout:(83/133): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 2.9 MB/s | 57 kB 00:00 2020-11-20T11:15:10.814 INFO:teuthology.orchestra.run.smithi204.stdout:(84/133): libuuid-devel-2.32.1-24.el8.x86_64.rp 4.2 MB/s | 96 kB 00:00 2020-11-20T11:15:10.814 INFO:teuthology.orchestra.run.smithi204.stdout:(85/133): libxslt-1.1.32-5.el8.x86_64.rpm 11 MB/s | 250 kB 00:00 2020-11-20T11:15:10.815 INFO:teuthology.orchestra.run.smithi204.stdout:(86/133): libcom_err-devel-1.45.6-1.el8.x86_64. 1.9 MB/s | 38 kB 00:00 2020-11-20T11:15:10.815 INFO:teuthology.orchestra.run.smithi204.stdout:(87/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 8.0 MB/s | 169 kB 00:00 2020-11-20T11:15:10.815 INFO:teuthology.orchestra.run.smithi204.stdout:(88/133): pcre2-devel-10.32-2.el8.x86_64.rpm 25 MB/s | 605 kB 00:00 2020-11-20T11:15:10.815 INFO:teuthology.orchestra.run.smithi204.stdout:(89/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2020-11-20T11:15:10.815 INFO:teuthology.orchestra.run.smithi204.stdout:(90/133): elfutils-libelf-devel-0.180-1.el8.x86 2.7 MB/s | 58 kB 00:00 2020-11-20T11:15:10.816 INFO:teuthology.orchestra.run.smithi204.stdout:(91/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 9.8 MB/s | 220 kB 00:00 2020-11-20T11:15:10.816 INFO:teuthology.orchestra.run.smithi204.stdout:(92/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 10 MB/s | 229 kB 00:00 2020-11-20T11:15:10.816 INFO:teuthology.orchestra.run.smithi204.stdout:(93/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 23 MB/s | 558 kB 00:00 2020-11-20T11:15:10.816 INFO:teuthology.orchestra.run.smithi204.stdout:(94/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 3.2 MB/s | 69 kB 00:00 2020-11-20T11:15:10.816 INFO:teuthology.orchestra.run.smithi204.stdout:(95/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.1 MB/s | 47 kB 00:00 2020-11-20T11:15:10.817 INFO:teuthology.orchestra.run.smithi204.stdout:(96/133): openssl-devel-1.1.1g-11.el8.x86_64.rp 65 MB/s | 2.3 MB 00:00 2020-11-20T11:15:10.817 INFO:teuthology.orchestra.run.smithi204.stdout:(97/133): automake-1.16.1-6.el8.noarch.rpm 29 MB/s | 713 kB 00:00 2020-11-20T11:15:10.829 INFO:teuthology.orchestra.run.smithi204.stdout:(98/133): python3-webencodings-0.5.1-6.el8.noar 1.3 MB/s | 27 kB 00:00 2020-11-20T11:15:10.841 INFO:teuthology.orchestra.run.smithi166.stdout:(23/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.8 MB/s | 18 MB 00:06 2020-11-20T11:15:10.873 INFO:teuthology.orchestra.run.smithi204.stdout:(99/133): ceph-mgr-diskprediction-local-16.0.0- 3.9 MB/s | 8.6 MB 00:02 2020-11-20T11:15:10.892 INFO:teuthology.orchestra.run.smithi204.stdout:(100/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 24 MB/s | 1.5 MB 00:00 2020-11-20T11:15:10.896 INFO:teuthology.orchestra.run.smithi166.stdout:(24/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.2 MB/s | 3.2 MB 00:00 2020-11-20T11:15:10.897 INFO:teuthology.orchestra.run.smithi166.stdout:(25/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.0 MB/s | 171 kB 00:00 2020-11-20T11:15:10.911 INFO:teuthology.orchestra.run.smithi204.stdout:(101/133): jq-1.5-12.el8.x86_64.rpm 4.1 MB/s | 161 kB 00:00 2020-11-20T11:15:10.917 INFO:teuthology.orchestra.run.smithi204.stdout:(102/133): python3-pyOpenSSL-18.0.0-1.el8.noarc 3.9 MB/s | 103 kB 00:00 2020-11-20T11:15:10.933 INFO:teuthology.orchestra.run.smithi166.stdout:(26/133): ceph-grafana-dashboards-16.0.0-7397.g 640 kB/s | 24 kB 00:00 2020-11-20T11:15:10.937 INFO:teuthology.orchestra.run.smithi204.stdout:(103/133): python3-werkzeug-0.12.2-4.el8.noarch 18 MB/s | 457 kB 00:00 2020-11-20T11:15:10.938 INFO:teuthology.orchestra.run.smithi166.stdout:(27/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.6 MB/s | 66 kB 00:00 2020-11-20T11:15:10.944 INFO:teuthology.orchestra.run.smithi204.stdout:(104/133): python3-mako-1.0.6-13.el8.noarch.rpm 5.8 MB/s | 157 kB 00:00 2020-11-20T11:15:10.956 INFO:teuthology.orchestra.run.smithi204.stdout:(105/133): python3-jsonpatch-1.21-2.el8.noarch. 1.3 MB/s | 27 kB 00:00 2020-11-20T11:15:10.972 INFO:teuthology.orchestra.run.smithi204.stdout:(106/133): python3-jsonpointer-1.10-11.el8.noar 731 kB/s | 20 kB 00:00 2020-11-20T11:15:10.979 INFO:teuthology.orchestra.run.smithi204.stdout:(107/133): python3-html5lib-0.999999999-6.el8.n 8.9 MB/s | 214 kB 00:00 2020-11-20T11:15:10.996 INFO:teuthology.orchestra.run.smithi204.stdout:(108/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.2 MB/s | 126 kB 00:00 2020-11-20T11:15:11.002 INFO:teuthology.orchestra.run.smithi204.stdout:(109/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.3 MB/s | 54 kB 00:00 2020-11-20T11:15:11.019 INFO:teuthology.orchestra.run.smithi204.stdout:(110/133): python3-pyasn1-modules-0.3.7-6.el8.n 4.5 MB/s | 110 kB 00:00 2020-11-20T11:15:11.027 INFO:teuthology.orchestra.run.smithi204.stdout:(111/133): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2020-11-20T11:15:11.039 INFO:teuthology.orchestra.run.smithi204.stdout:(112/133): python3-markupsafe-0.23-19.el8.x86_6 1.9 MB/s | 39 kB 00:00 2020-11-20T11:15:11.052 INFO:teuthology.orchestra.run.smithi204.stdout:(113/133): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2020-11-20T11:15:11.070 INFO:teuthology.orchestra.run.smithi204.stdout:(114/133): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2020-11-20T11:15:11.083 INFO:teuthology.orchestra.run.smithi204.stdout:(115/133): bison-3.0.4-10.el8.x86_64.rpm 22 MB/s | 688 kB 00:00 2020-11-20T11:15:11.103 INFO:teuthology.orchestra.run.smithi204.stdout:(116/133): libtool-2.4.6-25.el8.x86_64.rpm 22 MB/s | 709 kB 00:00 2020-11-20T11:15:11.113 INFO:teuthology.orchestra.run.smithi204.stdout:(117/133): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2020-11-20T11:15:11.139 INFO:teuthology.orchestra.run.smithi204.stdout:(118/133): python3-numpy-f2py-1.14.3-9.el8.x86_ 10 MB/s | 225 kB 00:00 2020-11-20T11:15:11.197 INFO:teuthology.orchestra.run.smithi204.stdout:(119/133): python3-babel-2.5.1-5.el8.noarch.rpm 84 MB/s | 4.8 MB 00:00 2020-11-20T11:15:11.219 INFO:teuthology.orchestra.run.smithi204.stdout:(120/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2020-11-20T11:15:11.318 INFO:teuthology.orchestra.run.smithi204.stdout:(121/133): python3-scipy-1.0.0-20.module+el8.1. 67 MB/s | 15 MB 00:00 2020-11-20T11:15:11.367 INFO:teuthology.orchestra.run.smithi204.stdout:(122/133): python3-numpy-1.14.3-9.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2020-11-20T11:15:11.395 INFO:teuthology.orchestra.run.smithi204.stdout:(123/133): openblas-threads-0.3.3-5.el8.x86_64. 60 MB/s | 4.4 MB 00:00 2020-11-20T11:15:11.417 INFO:teuthology.orchestra.run.smithi204.stdout:(124/133): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2020-11-20T11:15:11.436 INFO:teuthology.orchestra.run.smithi204.stdout:(125/133): openblas-0.3.3-5.el8.x86_64.rpm 62 MB/s | 4.3 MB 00:00 2020-11-20T11:15:11.448 INFO:teuthology.orchestra.run.smithi204.stdout:(126/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.0 MB/s | 187 kB 00:00 2020-11-20T11:15:11.551 INFO:teuthology.orchestra.run.smithi166.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 5.1 MB/s | 3.2 MB 00:00 2020-11-20T11:15:11.611 INFO:teuthology.orchestra.run.smithi166.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 3.3 MB/s | 198 kB 00:00 2020-11-20T11:15:11.668 INFO:teuthology.orchestra.run.smithi166.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 479 kB/s | 27 kB 00:00 2020-11-20T11:15:11.727 INFO:teuthology.orchestra.run.smithi166.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 148 kB/s | 8.8 kB 00:00 2020-11-20T11:15:11.792 INFO:teuthology.orchestra.run.smithi166.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 895 kB/s | 57 kB 00:00 2020-11-20T11:15:11.891 INFO:teuthology.orchestra.run.smithi166.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.1 MB/s | 116 kB 00:00 2020-11-20T11:15:11.932 INFO:teuthology.orchestra.run.smithi166.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.6 MB/s | 315 kB 00:00 2020-11-20T11:15:11.952 INFO:teuthology.orchestra.run.smithi166.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:15:11.972 INFO:teuthology.orchestra.run.smithi166.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:15:11.993 INFO:teuthology.orchestra.run.smithi166.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:15:12.013 INFO:teuthology.orchestra.run.smithi166.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:15:12.034 INFO:teuthology.orchestra.run.smithi166.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.0 MB/s | 44 kB 00:00 2020-11-20T11:15:12.057 INFO:teuthology.orchestra.run.smithi166.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.7 MB/s | 185 kB 00:00 2020-11-20T11:15:12.075 INFO:teuthology.orchestra.run.smithi166.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:15:12.095 INFO:teuthology.orchestra.run.smithi166.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 824 kB/s | 16 kB 00:00 2020-11-20T11:15:12.118 INFO:teuthology.orchestra.run.smithi166.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.7 MB/s | 145 kB 00:00 2020-11-20T11:15:12.157 INFO:teuthology.orchestra.run.smithi166.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 9.5 MB/s | 384 kB 00:00 2020-11-20T11:15:12.168 INFO:teuthology.orchestra.run.smithi204.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 3.3 MB/s | 2.4 MB 00:00 2020-11-20T11:15:12.175 INFO:teuthology.orchestra.run.smithi166.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T11:15:12.198 INFO:teuthology.orchestra.run.smithi166.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 16 MB/s | 355 kB 00:00 2020-11-20T11:15:12.200 INFO:teuthology.orchestra.run.smithi204.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 54 MB/s | 1.7 MB 00:00 2020-11-20T11:15:12.218 INFO:teuthology.orchestra.run.smithi166.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:15:12.222 INFO:teuthology.orchestra.run.smithi204.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 14 MB/s | 320 kB 00:00 2020-11-20T11:15:12.237 INFO:teuthology.orchestra.run.smithi166.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 569 kB/s | 11 kB 00:00 2020-11-20T11:15:12.244 INFO:teuthology.orchestra.run.smithi204.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.3 MB/s | 141 kB 00:00 2020-11-20T11:15:12.257 INFO:teuthology.orchestra.run.smithi166.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 891 kB/s | 18 kB 00:00 2020-11-20T11:15:12.281 INFO:teuthology.orchestra.run.smithi204.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 65 MB/s | 2.4 MB 00:00 2020-11-20T11:15:12.319 INFO:teuthology.orchestra.run.smithi166.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 19 MB/s | 1.2 MB 00:00 2020-11-20T11:15:12.339 INFO:teuthology.orchestra.run.smithi166.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:15:12.359 INFO:teuthology.orchestra.run.smithi166.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T11:15:12.381 INFO:teuthology.orchestra.run.smithi166.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:15:12.401 INFO:teuthology.orchestra.run.smithi166.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 795 kB/s | 16 kB 00:00 2020-11-20T11:15:12.421 INFO:teuthology.orchestra.run.smithi166.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.4 MB/s | 48 kB 00:00 2020-11-20T11:15:12.441 INFO:teuthology.orchestra.run.smithi166.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2020-11-20T11:15:12.462 INFO:teuthology.orchestra.run.smithi166.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 9.2 MB/s | 196 kB 00:00 2020-11-20T11:15:12.482 INFO:teuthology.orchestra.run.smithi166.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T11:15:12.501 INFO:teuthology.orchestra.run.smithi204.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 3.5 MB/s | 3.7 MB 00:01 2020-11-20T11:15:12.501 INFO:teuthology.orchestra.run.smithi166.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 957 kB/s | 19 kB 00:00 2020-11-20T11:15:12.521 INFO:teuthology.orchestra.run.smithi166.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:15:12.542 INFO:teuthology.orchestra.run.smithi166.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2020-11-20T11:15:12.561 INFO:teuthology.orchestra.run.smithi166.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2020-11-20T11:15:12.583 INFO:teuthology.orchestra.run.smithi166.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 11 MB/s | 241 kB 00:00 2020-11-20T11:15:12.604 INFO:teuthology.orchestra.run.smithi166.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-11-20T11:15:12.625 INFO:teuthology.orchestra.run.smithi166.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T11:15:12.645 INFO:teuthology.orchestra.run.smithi166.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.2 MB/s | 85 kB 00:00 2020-11-20T11:15:12.665 INFO:teuthology.orchestra.run.smithi166.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T11:15:12.685 INFO:teuthology.orchestra.run.smithi166.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2020-11-20T11:15:12.721 INFO:teuthology.orchestra.run.smithi166.stdout:(69/133): automake-1.16.1-6.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2020-11-20T11:15:12.741 INFO:teuthology.orchestra.run.smithi166.stdout:(70/133): python3-webencodings-0.5.1-6.el8.noar 1.3 MB/s | 27 kB 00:00 2020-11-20T11:15:12.769 INFO:teuthology.orchestra.run.smithi166.stdout:(71/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 54 MB/s | 1.5 MB 00:00 2020-11-20T11:15:12.794 INFO:teuthology.orchestra.run.smithi166.stdout:(72/133): jq-1.5-12.el8.x86_64.rpm 6.2 MB/s | 161 kB 00:00 2020-11-20T11:15:12.819 INFO:teuthology.orchestra.run.smithi166.stdout:(73/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2020-11-20T11:15:12.850 INFO:teuthology.orchestra.run.smithi166.stdout:(74/133): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2020-11-20T11:15:12.874 INFO:teuthology.orchestra.run.smithi166.stdout:(75/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2020-11-20T11:15:12.897 INFO:teuthology.orchestra.run.smithi166.stdout:(76/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2020-11-20T11:15:12.920 INFO:teuthology.orchestra.run.smithi166.stdout:(77/133): python3-jsonpointer-1.10-11.el8.noarc 863 kB/s | 20 kB 00:00 2020-11-20T11:15:12.941 INFO:teuthology.orchestra.run.smithi166.stdout:(78/133): python3-html5lib-0.999999999-6.el8.no 9.8 MB/s | 214 kB 00:00 2020-11-20T11:15:12.966 INFO:teuthology.orchestra.run.smithi166.stdout:(79/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.1 MB/s | 126 kB 00:00 2020-11-20T11:15:12.989 INFO:teuthology.orchestra.run.smithi166.stdout:(80/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.3 MB/s | 54 kB 00:00 2020-11-20T11:15:12.990 INFO:teuthology.orchestra.run.smithi112.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 2.2 MB/s | 23 MB 00:10 2020-11-20T11:15:13.013 INFO:teuthology.orchestra.run.smithi166.stdout:(81/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.5 MB/s | 110 kB 00:00 2020-11-20T11:15:13.035 INFO:teuthology.orchestra.run.smithi112.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 549 kB/s | 25 kB 00:00 2020-11-20T11:15:13.037 INFO:teuthology.orchestra.run.smithi166.stdout:(82/133): python3-prettytable-0.7.2-14.el8.noar 1.8 MB/s | 44 kB 00:00 2020-11-20T11:15:13.059 INFO:teuthology.orchestra.run.smithi166.stdout:(83/133): python3-markupsafe-0.23-19.el8.x86_64 1.7 MB/s | 39 kB 00:00 2020-11-20T11:15:13.084 INFO:teuthology.orchestra.run.smithi166.stdout:(84/133): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2020-11-20T11:15:13.106 INFO:teuthology.orchestra.run.smithi166.stdout:(85/133): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2020-11-20T11:15:13.129 INFO:teuthology.orchestra.run.smithi166.stdout:(86/133): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2020-11-20T11:15:13.154 INFO:teuthology.orchestra.run.smithi166.stdout:(87/133): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2020-11-20T11:15:13.179 INFO:teuthology.orchestra.run.smithi166.stdout:(88/133): python3-jinja2-2.10.1-2.el8_0.noarch. 21 MB/s | 538 kB 00:00 2020-11-20T11:15:13.265 INFO:teuthology.orchestra.run.smithi166.stdout:(89/133): ceph-mgr-diskprediction-local-16.0.0- 3.7 MB/s | 8.6 MB 00:02 2020-11-20T11:15:13.299 INFO:teuthology.orchestra.run.smithi166.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 6.6 MB/s | 225 kB 00:00 2020-11-20T11:15:13.426 INFO:teuthology.orchestra.run.smithi166.stdout:(91/133): python3-scipy-1.0.0-20.module+el8.1.0 59 MB/s | 15 MB 00:00 2020-11-20T11:15:13.449 INFO:teuthology.orchestra.run.smithi166.stdout:(92/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2020-11-20T11:15:13.456 INFO:teuthology.orchestra.run.smithi112.stdout:(10/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.6 MB/s | 18 MB 00:06 2020-11-20T11:15:13.471 INFO:teuthology.orchestra.run.smithi166.stdout:(93/133): python3-babel-2.5.1-5.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2020-11-20T11:15:13.494 INFO:teuthology.orchestra.run.smithi112.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 623 kB/s | 24 kB 00:00 2020-11-20T11:15:13.509 INFO:teuthology.orchestra.run.smithi166.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2020-11-20T11:15:13.557 INFO:teuthology.orchestra.run.smithi166.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 53 MB/s | 4.4 MB 00:00 2020-11-20T11:15:13.578 INFO:teuthology.orchestra.run.smithi166.stdout:(96/133): openblas-0.3.3-5.el8.x86_64.rpm 63 MB/s | 4.3 MB 00:00 2020-11-20T11:15:13.592 INFO:teuthology.orchestra.run.smithi166.stdout:(97/133): socat-1.7.3.3-2.el8.x86_64.rpm 8.5 MB/s | 302 kB 00:00 2020-11-20T11:15:13.613 INFO:teuthology.orchestra.run.smithi166.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.2 MB/s | 187 kB 00:00 2020-11-20T11:15:13.621 INFO:teuthology.orchestra.run.smithi166.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.1 MB/s | 238 kB 00:00 2020-11-20T11:15:13.626 INFO:teuthology.orchestra.run.smithi112.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 4.2 MB/s | 562 kB 00:00 2020-11-20T11:15:13.638 INFO:teuthology.orchestra.run.smithi166.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 713 kB/s | 18 kB 00:00 2020-11-20T11:15:13.646 INFO:teuthology.orchestra.run.smithi166.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 6.9 MB/s | 181 kB 00:00 2020-11-20T11:15:13.660 INFO:teuthology.orchestra.run.smithi166.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 2.1 MB/s | 43 kB 00:00 2020-11-20T11:15:13.669 INFO:teuthology.orchestra.run.smithi112.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 3.0 MB/s | 131 kB 00:00 2020-11-20T11:15:13.671 INFO:teuthology.orchestra.run.smithi166.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2020-11-20T11:15:13.684 INFO:teuthology.orchestra.run.smithi166.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 4.1 MB/s | 109 kB 00:00 2020-11-20T11:15:13.703 INFO:teuthology.orchestra.run.smithi166.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 1.7 MB/s | 48 kB 00:00 2020-11-20T11:15:13.710 INFO:teuthology.orchestra.run.smithi166.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2020-11-20T11:15:13.729 INFO:teuthology.orchestra.run.smithi166.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 5.9 MB/s | 155 kB 00:00 2020-11-20T11:15:13.735 INFO:teuthology.orchestra.run.smithi166.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 823 kB/s | 21 kB 00:00 2020-11-20T11:15:13.754 INFO:teuthology.orchestra.run.smithi166.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2020-11-20T11:15:13.760 INFO:teuthology.orchestra.run.smithi166.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 758 kB/s | 19 kB 00:00 2020-11-20T11:15:13.781 INFO:teuthology.orchestra.run.smithi166.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 7.2 MB/s | 199 kB 00:00 2020-11-20T11:15:13.791 INFO:teuthology.orchestra.run.smithi166.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 17 MB/s | 511 kB 00:00 2020-11-20T11:15:13.799 INFO:teuthology.orchestra.run.smithi112.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 3.7 MB/s | 486 kB 00:00 2020-11-20T11:15:13.803 INFO:teuthology.orchestra.run.smithi166.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.6 MB/s | 57 kB 00:00 2020-11-20T11:15:13.816 INFO:teuthology.orchestra.run.smithi166.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 4.5 MB/s | 96 kB 00:00 2020-11-20T11:15:13.828 INFO:teuthology.orchestra.run.smithi166.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 9.4 MB/s | 250 kB 00:00 2020-11-20T11:15:13.841 INFO:teuthology.orchestra.run.smithi166.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.8 MB/s | 38 kB 00:00 2020-11-20T11:15:13.854 INFO:teuthology.orchestra.run.smithi166.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.5 MB/s | 169 kB 00:00 2020-11-20T11:15:13.869 INFO:teuthology.orchestra.run.smithi166.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-11-20T11:15:13.884 INFO:teuthology.orchestra.run.smithi166.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2020-11-20T11:15:13.896 INFO:teuthology.orchestra.run.smithi166.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.5 MB/s | 58 kB 00:00 2020-11-20T11:15:13.908 INFO:teuthology.orchestra.run.smithi112.stdout:(15/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 2.7 MB/s | 12 MB 00:04 2020-11-20T11:15:13.916 INFO:teuthology.orchestra.run.smithi166.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.7 MB/s | 220 kB 00:00 2020-11-20T11:15:13.923 INFO:teuthology.orchestra.run.smithi166.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.2 MB/s | 229 kB 00:00 2020-11-20T11:15:13.943 INFO:teuthology.orchestra.run.smithi166.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 20 MB/s | 558 kB 00:00 2020-11-20T11:15:13.949 INFO:teuthology.orchestra.run.smithi112.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 983 kB/s | 40 kB 00:00 2020-11-20T11:15:13.950 INFO:teuthology.orchestra.run.smithi166.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 2.6 MB/s | 69 kB 00:00 2020-11-20T11:15:13.972 INFO:teuthology.orchestra.run.smithi166.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2020-11-20T11:15:13.987 INFO:teuthology.orchestra.run.smithi166.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 63 MB/s | 2.3 MB 00:00 2020-11-20T11:15:13.992 INFO:teuthology.orchestra.run.smithi112.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.7 MB/s | 73 kB 00:00 2020-11-20T11:15:14.081 INFO:teuthology.orchestra.run.smithi112.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.2 MB/s | 204 kB 00:00 2020-11-20T11:15:14.237 INFO:teuthology.orchestra.run.smithi112.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 2.4 MB/s | 375 kB 00:00 2020-11-20T11:15:14.361 INFO:teuthology.orchestra.run.smithi112.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 2.8 MB/s | 353 kB 00:00 2020-11-20T11:15:14.424 INFO:teuthology.orchestra.run.smithi112.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.8 MB/s | 113 kB 00:00 2020-11-20T11:15:14.496 INFO:teuthology.orchestra.run.smithi112.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.2 MB/s | 88 kB 00:00 2020-11-20T11:15:14.708 INFO:teuthology.orchestra.run.smithi166.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 3.3 MB/s | 2.4 MB 00:00 2020-11-20T11:15:14.709 INFO:teuthology.orchestra.run.smithi112.stdout:(23/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.1 MB/s | 3.7 MB 00:00 2020-11-20T11:15:14.740 INFO:teuthology.orchestra.run.smithi166.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 55 MB/s | 1.7 MB 00:00 2020-11-20T11:15:14.751 INFO:teuthology.orchestra.run.smithi112.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 4.0 MB/s | 171 kB 00:00 2020-11-20T11:15:14.763 INFO:teuthology.orchestra.run.smithi166.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 14 MB/s | 320 kB 00:00 2020-11-20T11:15:14.784 INFO:teuthology.orchestra.run.smithi166.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.6 MB/s | 141 kB 00:00 2020-11-20T11:15:14.786 INFO:teuthology.orchestra.run.smithi112.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 681 kB/s | 24 kB 00:00 2020-11-20T11:15:14.819 INFO:teuthology.orchestra.run.smithi166.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 70 MB/s | 2.4 MB 00:00 2020-11-20T11:15:14.823 INFO:teuthology.orchestra.run.smithi112.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.8 MB/s | 66 kB 00:00 2020-11-20T11:15:14.912 INFO:teuthology.orchestra.run.smithi204.stdout:(133/133): ceph-test-16.0.0-7397.gb86e691b.el8. 6.2 MB/s | 48 MB 00:07 2020-11-20T11:15:14.917 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:15:14.918 INFO:teuthology.orchestra.run.smithi204.stdout:Total 16 MB/s | 199 MB 00:12 2020-11-20T11:15:14.985 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2020-11-20T11:15:15.005 INFO:teuthology.orchestra.run.smithi166.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 3.6 MB/s | 3.7 MB 00:01 2020-11-20T11:15:15.123 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2020-11-20T11:15:15.123 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2020-11-20T11:15:15.241 INFO:teuthology.orchestra.run.smithi112.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.3 MB/s | 3.2 MB 00:00 2020-11-20T11:15:15.324 INFO:teuthology.orchestra.run.smithi112.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 6.3 MB/s | 3.2 MB 00:00 2020-11-20T11:15:15.361 INFO:teuthology.orchestra.run.smithi112.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 5.3 MB/s | 198 kB 00:00 2020-11-20T11:15:15.393 INFO:teuthology.orchestra.run.smithi112.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 831 kB/s | 27 kB 00:00 2020-11-20T11:15:15.424 INFO:teuthology.orchestra.run.smithi112.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 292 kB/s | 8.8 kB 00:00 2020-11-20T11:15:15.455 INFO:teuthology.orchestra.run.smithi112.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.8 MB/s | 57 kB 00:00 2020-11-20T11:15:15.553 INFO:teuthology.orchestra.run.smithi112.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:15:15.594 INFO:teuthology.orchestra.run.smithi112.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.6 MB/s | 315 kB 00:00 2020-11-20T11:15:15.614 INFO:teuthology.orchestra.run.smithi112.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:15:15.634 INFO:teuthology.orchestra.run.smithi112.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:15:15.655 INFO:teuthology.orchestra.run.smithi112.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:15:15.674 INFO:teuthology.orchestra.run.smithi112.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T11:15:15.694 INFO:teuthology.orchestra.run.smithi112.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2020-11-20T11:15:15.715 INFO:teuthology.orchestra.run.smithi112.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.7 MB/s | 185 kB 00:00 2020-11-20T11:15:15.735 INFO:teuthology.orchestra.run.smithi112.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:15:15.755 INFO:teuthology.orchestra.run.smithi112.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 832 kB/s | 16 kB 00:00 2020-11-20T11:15:15.776 INFO:teuthology.orchestra.run.smithi112.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.8 MB/s | 145 kB 00:00 2020-11-20T11:15:15.799 INFO:teuthology.orchestra.run.smithi112.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 17 MB/s | 384 kB 00:00 2020-11-20T11:15:15.818 INFO:teuthology.orchestra.run.smithi112.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T11:15:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 16 MB/s | 355 kB 00:00 2020-11-20T11:15:15.861 INFO:teuthology.orchestra.run.smithi112.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:15:15.881 INFO:teuthology.orchestra.run.smithi112.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 570 kB/s | 11 kB 00:00 2020-11-20T11:15:15.901 INFO:teuthology.orchestra.run.smithi112.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 895 kB/s | 18 kB 00:00 2020-11-20T11:15:15.963 INFO:teuthology.orchestra.run.smithi112.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 19 MB/s | 1.2 MB 00:00 2020-11-20T11:15:15.983 INFO:teuthology.orchestra.run.smithi112.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:15:16.002 INFO:teuthology.orchestra.run.smithi112.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T11:15:16.025 INFO:teuthology.orchestra.run.smithi112.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:15:16.044 INFO:teuthology.orchestra.run.smithi112.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 792 kB/s | 16 kB 00:00 2020-11-20T11:15:16.064 INFO:teuthology.orchestra.run.smithi112.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.4 MB/s | 48 kB 00:00 2020-11-20T11:15:16.084 INFO:teuthology.orchestra.run.smithi112.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.6 MB/s | 34 kB 00:00 2020-11-20T11:15:16.106 INFO:teuthology.orchestra.run.smithi112.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 9.1 MB/s | 196 kB 00:00 2020-11-20T11:15:16.126 INFO:teuthology.orchestra.run.smithi112.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T11:15:16.147 INFO:teuthology.orchestra.run.smithi112.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 957 kB/s | 19 kB 00:00 2020-11-20T11:15:16.165 INFO:teuthology.orchestra.run.smithi112.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:15:16.186 INFO:teuthology.orchestra.run.smithi112.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2020-11-20T11:15:16.206 INFO:teuthology.orchestra.run.smithi112.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.3 MB/s | 27 kB 00:00 2020-11-20T11:15:16.227 INFO:teuthology.orchestra.run.smithi112.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 11 MB/s | 241 kB 00:00 2020-11-20T11:15:16.248 INFO:teuthology.orchestra.run.smithi112.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-11-20T11:15:16.266 INFO:teuthology.orchestra.run.smithi166.stdout:(133/133): ceph-test-16.0.0-7397.gb86e691b.el8. 5.9 MB/s | 48 MB 00:08 2020-11-20T11:15:16.270 INFO:teuthology.orchestra.run.smithi112.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T11:15:16.272 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:15:16.273 INFO:teuthology.orchestra.run.smithi166.stdout:Total 14 MB/s | 199 MB 00:13 2020-11-20T11:15:16.289 INFO:teuthology.orchestra.run.smithi112.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T11:15:16.309 INFO:teuthology.orchestra.run.smithi112.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T11:15:16.330 INFO:teuthology.orchestra.run.smithi112.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.3 MB/s | 69 kB 00:00 2020-11-20T11:15:16.336 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-20T11:15:16.369 INFO:teuthology.orchestra.run.smithi112.stdout:(69/133): ceph-mgr-diskprediction-local-16.0.0- 7.6 MB/s | 8.6 MB 00:01 2020-11-20T11:15:16.391 INFO:teuthology.orchestra.run.smithi112.stdout:(70/133): automake-1.16.1-6.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2020-11-20T11:15:16.403 INFO:teuthology.orchestra.run.smithi112.stdout:(71/133): python3-webencodings-0.5.1-6.el8.noar 791 kB/s | 27 kB 00:00 2020-11-20T11:15:16.430 INFO:teuthology.orchestra.run.smithi112.stdout:(72/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 44 MB/s | 1.5 MB 00:00 2020-11-20T11:15:16.431 INFO:teuthology.orchestra.run.smithi112.stdout:(73/133): jq-1.5-12.el8.x86_64.rpm 5.7 MB/s | 161 kB 00:00 2020-11-20T11:15:16.455 INFO:teuthology.orchestra.run.smithi112.stdout:(74/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 4.2 MB/s | 103 kB 00:00 2020-11-20T11:15:16.463 INFO:teuthology.orchestra.run.smithi112.stdout:(75/133): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2020-11-20T11:15:16.471 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-20T11:15:16.471 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-20T11:15:16.476 INFO:teuthology.orchestra.run.smithi112.stdout:(76/133): python3-mako-1.0.6-13.el8.noarch.rpm 7.1 MB/s | 157 kB 00:00 2020-11-20T11:15:16.487 INFO:teuthology.orchestra.run.smithi112.stdout:(77/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2020-11-20T11:15:16.503 INFO:teuthology.orchestra.run.smithi112.stdout:(78/133): python3-jsonpointer-1.10-11.el8.noarc 839 kB/s | 20 kB 00:00 2020-11-20T11:15:16.517 INFO:teuthology.orchestra.run.smithi112.stdout:(79/133): python3-html5lib-0.999999999-6.el8.no 7.0 MB/s | 214 kB 00:00 2020-11-20T11:15:16.525 INFO:teuthology.orchestra.run.smithi112.stdout:(80/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2020-11-20T11:15:16.541 INFO:teuthology.orchestra.run.smithi112.stdout:(81/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2020-11-20T11:15:16.549 INFO:teuthology.orchestra.run.smithi112.stdout:(82/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.4 MB/s | 110 kB 00:00 2020-11-20T11:15:16.566 INFO:teuthology.orchestra.run.smithi112.stdout:(83/133): python3-prettytable-0.7.2-14.el8.noar 1.8 MB/s | 44 kB 00:00 2020-11-20T11:15:16.573 INFO:teuthology.orchestra.run.smithi112.stdout:(84/133): python3-markupsafe-0.23-19.el8.x86_64 1.6 MB/s | 39 kB 00:00 2020-11-20T11:15:16.592 INFO:teuthology.orchestra.run.smithi112.stdout:(85/133): flex-2.6.1-9.el8.x86_64.rpm 12 MB/s | 320 kB 00:00 2020-11-20T11:15:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:(86/133): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2020-11-20T11:15:16.621 INFO:teuthology.orchestra.run.smithi112.stdout:(87/133): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2020-11-20T11:15:16.637 INFO:teuthology.orchestra.run.smithi112.stdout:(88/133): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2020-11-20T11:15:16.652 INFO:teuthology.orchestra.run.smithi112.stdout:(89/133): python3-jinja2-2.10.1-2.el8_0.noarch. 17 MB/s | 538 kB 00:00 2020-11-20T11:15:16.680 INFO:teuthology.orchestra.run.smithi112.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.1 MB/s | 225 kB 00:00 2020-11-20T11:15:16.711 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2020-11-20T11:15:16.714 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2020-11-20T11:15:16.744 INFO:teuthology.orchestra.run.smithi112.stdout:(91/133): python3-babel-2.5.1-5.el8.noarch.rpm 76 MB/s | 4.8 MB 00:00 2020-11-20T11:15:16.869 INFO:teuthology.orchestra.run.smithi112.stdout:(92/133): python3-scipy-1.0.0-20.module+el8.1.0 62 MB/s | 15 MB 00:00 2020-11-20T11:15:16.871 INFO:teuthology.orchestra.run.smithi112.stdout:(93/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2020-11-20T11:15:16.921 INFO:teuthology.orchestra.run.smithi112.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 72 MB/s | 3.7 MB 00:00 2020-11-20T11:15:16.949 INFO:teuthology.orchestra.run.smithi112.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 59 MB/s | 4.4 MB 00:00 2020-11-20T11:15:16.972 INFO:teuthology.orchestra.run.smithi112.stdout:(96/133): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2020-11-20T11:15:16.997 INFO:teuthology.orchestra.run.smithi112.stdout:(97/133): openblas-0.3.3-5.el8.x86_64.rpm 56 MB/s | 4.3 MB 00:00 2020-11-20T11:15:16.999 INFO:teuthology.orchestra.run.smithi112.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.8 MB/s | 187 kB 00:00 2020-11-20T11:15:17.025 INFO:teuthology.orchestra.run.smithi112.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.7 MB/s | 238 kB 00:00 2020-11-20T11:15:17.031 INFO:teuthology.orchestra.run.smithi112.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 560 kB/s | 18 kB 00:00 2020-11-20T11:15:17.055 INFO:teuthology.orchestra.run.smithi112.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 5.8 MB/s | 181 kB 00:00 2020-11-20T11:15:17.063 INFO:teuthology.orchestra.run.smithi112.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.3 MB/s | 43 kB 00:00 2020-11-20T11:15:17.083 INFO:teuthology.orchestra.run.smithi112.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 2.9 MB/s | 83 kB 00:00 2020-11-20T11:15:17.090 INFO:teuthology.orchestra.run.smithi112.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 3.9 MB/s | 109 kB 00:00 2020-11-20T11:15:17.108 INFO:teuthology.orchestra.run.smithi112.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 1.9 MB/s | 48 kB 00:00 2020-11-20T11:15:17.114 INFO:teuthology.orchestra.run.smithi112.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-11-20T11:15:17.129 INFO:teuthology.orchestra.run.smithi112.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 7.4 MB/s | 155 kB 00:00 2020-11-20T11:15:17.139 INFO:teuthology.orchestra.run.smithi112.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 858 kB/s | 21 kB 00:00 2020-11-20T11:15:17.155 INFO:teuthology.orchestra.run.smithi112.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2020-11-20T11:15:17.163 INFO:teuthology.orchestra.run.smithi112.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 822 kB/s | 19 kB 00:00 2020-11-20T11:15:17.180 INFO:teuthology.orchestra.run.smithi112.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 8.0 MB/s | 199 kB 00:00 2020-11-20T11:15:17.190 INFO:teuthology.orchestra.run.smithi112.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 18 MB/s | 511 kB 00:00 2020-11-20T11:15:17.201 INFO:teuthology.orchestra.run.smithi112.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.7 MB/s | 57 kB 00:00 2020-11-20T11:15:17.218 INFO:teuthology.orchestra.run.smithi112.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 3.9 MB/s | 96 kB 00:00 2020-11-20T11:15:17.227 INFO:teuthology.orchestra.run.smithi112.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 9.4 MB/s | 250 kB 00:00 2020-11-20T11:15:17.238 INFO:teuthology.orchestra.run.smithi112.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 2.0 MB/s | 38 kB 00:00 2020-11-20T11:15:17.251 INFO:teuthology.orchestra.run.smithi112.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.9 MB/s | 169 kB 00:00 2020-11-20T11:15:17.265 INFO:teuthology.orchestra.run.smithi112.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-11-20T11:15:17.284 INFO:teuthology.orchestra.run.smithi112.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2020-11-20T11:15:17.291 INFO:teuthology.orchestra.run.smithi112.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.6 MB/s | 58 kB 00:00 2020-11-20T11:15:17.309 INFO:teuthology.orchestra.run.smithi112.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.7 MB/s | 220 kB 00:00 2020-11-20T11:15:17.317 INFO:teuthology.orchestra.run.smithi112.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.6 MB/s | 229 kB 00:00 2020-11-20T11:15:17.336 INFO:teuthology.orchestra.run.smithi112.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 21 MB/s | 558 kB 00:00 2020-11-20T11:15:17.343 INFO:teuthology.orchestra.run.smithi112.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 2.7 MB/s | 69 kB 00:00 2020-11-20T11:15:17.358 INFO:teuthology.orchestra.run.smithi112.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.3 MB/s | 47 kB 00:00 2020-11-20T11:15:17.380 INFO:teuthology.orchestra.run.smithi112.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 63 MB/s | 2.3 MB 00:00 2020-11-20T11:15:17.962 INFO:teuthology.orchestra.run.smithi112.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 4.1 MB/s | 2.4 MB 00:00 2020-11-20T11:15:17.992 INFO:teuthology.orchestra.run.smithi112.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 57 MB/s | 1.7 MB 00:00 2020-11-20T11:15:18.014 INFO:teuthology.orchestra.run.smithi112.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 14 MB/s | 320 kB 00:00 2020-11-20T11:15:18.034 INFO:teuthology.orchestra.run.smithi112.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.9 MB/s | 141 kB 00:00 2020-11-20T11:15:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 72 MB/s | 2.4 MB 00:00 2020-11-20T11:15:18.108 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-20T11:15:18.113 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-20T11:15:18.384 INFO:teuthology.orchestra.run.smithi112.stdout:(132/133): ceph-test-16.0.0-7397.gb86e691b.el8. 8.9 MB/s | 48 MB 00:05 2020-11-20T11:15:18.465 INFO:teuthology.orchestra.run.smithi112.stdout:(133/133): librados2-16.0.0-7397.gb86e691b.el8. 3.4 MB/s | 3.7 MB 00:01 2020-11-20T11:15:18.469 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:15:18.470 INFO:teuthology.orchestra.run.smithi112.stdout:Total 13 MB/s | 199 MB 00:15 2020-11-20T11:15:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2020-11-20T11:15:18.666 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2020-11-20T11:15:18.667 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2020-11-20T11:15:20.303 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2020-11-20T11:15:20.307 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2020-11-20T11:15:21.568 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2020-11-20T11:15:21.623 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:15:21.803 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:15:21.939 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:15:22.111 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:15:22.279 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:15:22.688 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:15:22.879 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:15:23.170 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:15:23.217 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-20T11:15:23.275 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:15:23.355 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:15:23.466 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:15:23.620 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:15:23.884 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:15:24.001 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T11:15:24.045 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:15:24.102 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:15:24.131 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:15:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:15:24.606 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 10/139 2020-11-20T11:15:24.720 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:24.748 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:24.815 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:25.049 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:15:25.057 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:25.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:15:25.265 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:25.353 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:25.378 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2020-11-20T11:15:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:15:25.548 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:15:25.642 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:15:25.686 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:15:25.748 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:25.823 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:15:25.837 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:15:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:15:25.978 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:25.998 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:15:26.048 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:26.135 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T11:15:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:15:26.350 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:26.371 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:15:26.498 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:26.570 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:26.608 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:15:26.826 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:15:26.888 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:26.955 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:27.008 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:15:27.060 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/139 2020-11-20T11:15:27.131 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:27.245 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:15:27.332 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/139 2020-11-20T11:15:27.456 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:27.506 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:27.536 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/139 2020-11-20T11:15:27.584 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:15:27.703 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:15:27.738 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:15:27.772 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:27.822 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:15:27.825 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:15:27.844 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:27.962 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:15:28.175 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:28.423 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:28.478 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:15:28.775 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:28.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:15:28.905 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:15:29.055 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:15:29.066 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:15:29.129 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:15:29.181 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:15:29.261 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:15:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:15:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:29.680 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:15:29.712 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:15:29.839 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:15:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:15:29.977 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:15:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:15:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:30.380 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:15:30.497 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:15:30.526 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/139 2020-11-20T11:15:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:15:30.743 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/139 2020-11-20T11:15:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:30.931 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 26/139 2020-11-20T11:15:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:15:31.139 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:15:31.230 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:15:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:31.333 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:15:31.475 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:15:31.791 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:31.792 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T11:15:31.792 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T11:15:31.792 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:15:31.869 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:15:31.871 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 31/139 2020-11-20T11:15:31.876 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T11:15:32.038 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:15:32.045 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T11:15:32.061 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:15:32.159 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:15:32.329 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T11:15:32.346 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:15:32.614 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T11:15:32.856 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:15:32.863 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:15:33.018 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:15:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:15:33.177 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:15:33.543 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:15:33.680 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:15:34.066 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:15:34.100 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:15:34.391 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T11:15:34.413 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:15:34.626 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T11:15:34.705 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T11:15:34.893 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T11:15:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T11:15:35.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T11:15:35.117 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 33/139 2020-11-20T11:15:35.145 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T11:15:35.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T11:15:35.346 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:15:35.433 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/139 2020-11-20T11:15:35.473 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T11:15:35.650 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/139 2020-11-20T11:15:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T11:15:35.928 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 36/139 2020-11-20T11:15:35.986 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:15:36.099 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:15:36.142 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:15:36.247 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:15:36.300 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:15:36.434 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:15:36.616 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:15:36.780 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:15:36.910 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:15:36.994 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:15:37.173 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.5-12.el8.x86_64 43/139 2020-11-20T11:15:37.194 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:15:37.327 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/139 2020-11-20T11:15:37.335 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:15:37.498 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T11:15:37.500 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/139 2020-11-20T11:15:37.642 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 46/139 2020-11-20T11:15:37.645 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T11:15:37.751 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T11:15:37.813 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 47/139 2020-11-20T11:15:37.876 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:15:38.015 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 48/139 2020-11-20T11:15:38.016 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:15:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T11:15:38.237 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:15:38.243 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T11:15:38.253 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 49/139 2020-11-20T11:15:38.384 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:15:38.420 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:15:38.480 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.1-6.el8.noarch 50/139 2020-11-20T11:15:38.566 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:15:38.687 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 51/139 2020-11-20T11:15:38.715 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T11:15:39.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/139 2020-11-20T11:15:39.046 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T11:15:39.206 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/139 2020-11-20T11:15:39.226 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T11:15:39.353 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T11:15:39.359 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 54/139 2020-11-20T11:15:39.509 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 55/139 2020-11-20T11:15:39.519 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T11:15:39.760 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T11:15:39.761 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 56/139 2020-11-20T11:15:39.924 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T11:15:39.924 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T11:15:39.924 INFO:teuthology.orchestra.run.smithi166.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:15:39.925 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:15:39.962 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 57/139 2020-11-20T11:15:39.963 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 58/139 2020-11-20T11:15:39.963 INFO:teuthology.orchestra.run.smithi204.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:15:39.963 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:15:40.339 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/139 2020-11-20T11:15:40.420 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:15:40.516 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/139 2020-11-20T11:15:40.727 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T11:15:40.804 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T11:15:40.808 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/139 2020-11-20T11:15:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T11:15:40.967 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:15:41.004 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 62/139 2020-11-20T11:15:41.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:15:41.201 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T11:15:41.289 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 63/139 2020-11-20T11:15:41.361 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:15:41.450 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T11:15:41.534 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:15:41.624 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 64/139 2020-11-20T11:15:41.706 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T11:15:41.731 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:15:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 65/139 2020-11-20T11:15:41.897 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T11:15:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T11:15:42.114 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/139 2020-11-20T11:15:42.226 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T11:15:42.299 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T11:15:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 67/139 2020-11-20T11:15:42.391 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T11:15:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T11:15:42.501 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T11:15:42.540 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/139 2020-11-20T11:15:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T11:15:42.769 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/139 2020-11-20T11:15:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T11:15:42.922 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T11:15:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/139 2020-11-20T11:15:42.985 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T11:15:43.089 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T11:15:43.089 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T11:15:43.090 INFO:teuthology.orchestra.run.smithi112.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:15:43.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:15:43.134 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 71/139 2020-11-20T11:15:43.154 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T11:15:43.352 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 72/139 2020-11-20T11:15:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T11:15:43.482 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T11:15:43.530 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:15:43.538 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T11:15:43.642 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T11:15:43.763 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:15:43.807 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T11:15:43.856 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T11:15:43.958 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:15:43.962 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:15:44.070 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:15:44.088 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T11:15:44.097 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:15:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:15:44.274 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T11:15:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T11:15:44.442 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:15:44.471 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T11:15:44.636 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:15:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T11:15:44.686 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T11:15:44.795 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:15:44.829 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T11:15:44.890 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T11:15:44.948 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:15:45.059 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T11:15:45.105 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T11:15:45.158 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:15:45.278 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T11:15:45.362 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:15:45.380 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T11:15:45.568 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T11:15:45.590 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T11:15:45.598 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:15:45.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T11:15:45.779 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T11:15:45.823 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:15:45.947 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T11:15:45.991 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:15:46.070 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:15:46.130 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T11:15:46.281 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:15:46.396 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T11:15:46.413 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:15:46.468 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:15:46.603 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:15:46.632 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:15:46.673 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:15:46.690 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:15:46.781 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:15:46.844 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:15:46.890 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T11:15:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:15:47.086 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T11:15:47.134 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:15:47.189 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:15:47.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T11:15:47.323 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:15:47.375 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:15:47.443 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T11:15:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:15:47.557 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:15:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:15:47.714 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T11:15:47.758 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:15:47.907 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:15:47.942 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T11:15:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:15:48.219 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T11:15:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T11:15:48.449 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:15:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:15:48.706 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:15:48.847 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:15:48.852 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:15:49.049 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:15:49.051 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:15:49.065 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:15:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:15:49.299 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:15:49.346 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:15:49.422 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:15:49.514 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:15:49.629 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:15:49.646 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:15:49.735 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:15:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:15:49.895 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:15:49.934 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:15:50.014 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:15:50.076 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:15:50.150 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:15:50.193 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:15:50.393 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:15:50.398 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:15:50.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:15:50.576 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:15:50.776 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:15:51.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:15:51.248 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:15:51.591 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:15:51.703 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:15:51.860 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:15:51.968 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:15:52.103 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:15:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:15:52.367 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:15:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:15:52.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:15:52.652 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:15:52.758 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:15:52.822 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:15:52.957 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:15:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:15:54.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:15:54.144 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:15:54.358 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:54.533 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:15:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:15:54.937 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:15:55.066 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:55.122 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:15:55.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:15:55.342 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:15:55.453 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:15:55.607 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:15:57.065 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:57.294 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:57.999 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:58.307 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:15:58.389 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:15:58.551 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:15:59.312 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:15:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:16:00.433 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:16:00.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:16:00.846 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:16:00.992 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:16:12.643 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:16:12.644 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2020-11-20T11:16:12.644 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2020-11-20T11:16:12.644 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /dev 2020-11-20T11:16:12.645 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /run 2020-11-20T11:16:12.645 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2020-11-20T11:16:12.645 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2020-11-20T11:16:12.645 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2020-11-20T11:16:12.645 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2020-11-20T11:16:12.646 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /dev 2020-11-20T11:16:12.646 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:12.990 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:13.423 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:13.752 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:15.264 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:16.085 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:16:16.086 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /sys 2020-11-20T11:16:16.086 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /proc 2020-11-20T11:16:16.086 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2020-11-20T11:16:16.086 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /run 2020-11-20T11:16:16.087 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /mnt 2020-11-20T11:16:16.087 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /var/tmp 2020-11-20T11:16:16.087 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /home 2020-11-20T11:16:16.087 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /tmp 2020-11-20T11:16:16.087 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2020-11-20T11:16:16.088 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:16.449 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:16.884 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:17.046 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:17.589 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:17.810 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:16:17.929 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2020-11-20T11:16:17.929 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2020-11-20T11:16:17.929 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2020-11-20T11:16:17.929 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2020-11-20T11:16:17.930 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2020-11-20T11:16:17.930 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2020-11-20T11:16:17.930 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2020-11-20T11:16:17.930 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2020-11-20T11:16:17.930 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2020-11-20T11:16:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:17.962 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:16:18.107 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:16:18.238 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:18.307 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:18.557 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:16:18.884 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:19.126 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:19.963 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:20.396 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:16:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:16:21.011 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:21.033 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:21.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:21.255 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:21.275 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:21.372 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:16:21.551 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:16:21.656 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:16:21.665 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:21.821 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:21.852 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:21.996 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:22.012 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:22.553 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:22.714 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:23.102 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:16:23.149 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:16:23.245 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:16:23.372 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:23.401 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:16:23.525 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:23.733 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:23.879 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:24.048 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:24.135 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:24.407 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:16:24.692 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:24.899 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:16:25.053 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:25.085 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:25.231 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:25.249 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:25.730 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:16:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:26.016 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:16:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:16:26.412 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:16:26.525 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:26.556 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:16:26.614 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:16:26.985 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:27.139 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:27.933 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:16:28.264 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:29.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:29.206 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:16:29.490 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 120/139 2020-11-20T11:16:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:16:29.683 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 121/139 2020-11-20T11:16:29.705 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:29.901 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 122/139 2020-11-20T11:16:30.063 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:16:30.079 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:16:30.249 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:16:30.413 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:16:30.623 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:16:30.778 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:16:30.945 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:31.123 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:16:31.320 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:31.434 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:31.522 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:31.603 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:16:31.663 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:16:31.841 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:16:31.844 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:16:31.859 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:16:31.998 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/139 2020-11-20T11:16:32.055 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:16:32.129 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:16:32.130 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:32.346 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:32.447 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:16:32.461 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:32.461 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:32.757 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:16:32.865 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:32.865 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:33.050 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T11:16:33.064 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:33.064 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:33.215 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T11:16:33.427 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T11:16:33.618 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:16:33.781 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:16:33.841 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:33.841 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:16:33.841 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:16:33.841 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:16:33.842 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:16:33.842 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:16:33.842 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:16:33.842 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:16:33.842 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:16:33.843 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:16:33.843 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:16:33.843 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:16:33.843 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:16:33.844 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:16:33.844 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:16:33.844 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:16:33.844 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:16:33.844 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:16:33.845 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:16:33.845 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:16:33.845 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:16:33.849 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:16:33.849 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:16:33.849 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:16:33.850 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:16:33.850 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:16:33.850 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:16:33.850 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:16:33.850 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:16:33.851 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:16:33.851 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:16:33.851 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:16:33.851 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:16:33.851 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:16:33.852 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:16:33.852 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:16:33.852 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:16:33.852 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:16:33.852 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:16:33.853 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:16:33.853 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:16:33.853 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:16:33.853 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:16:33.853 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:16:33.854 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:16:33.854 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:16:33.854 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:16:33.854 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:16:33.854 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:16:33.855 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:16:33.855 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:16:33.855 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:16:33.855 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:16:33.855 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:16:33.856 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:16:33.856 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:16:33.856 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:16:33.856 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:16:33.856 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:16:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:16:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:16:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:16:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:16:33.857 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:16:33.858 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:16:33.858 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:16:33.858 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:16:33.858 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:16:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:16:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:16:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:16:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 71/139 2020-11-20T11:16:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/139 2020-11-20T11:16:33.860 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 73/139 2020-11-20T11:16:33.860 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/139 2020-11-20T11:16:33.860 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/139 2020-11-20T11:16:33.860 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/139 2020-11-20T11:16:33.860 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/139 2020-11-20T11:16:33.861 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 78/139 2020-11-20T11:16:33.861 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 79/139 2020-11-20T11:16:33.861 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 80/139 2020-11-20T11:16:33.861 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 81/139 2020-11-20T11:16:33.861 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/139 2020-11-20T11:16:33.862 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 83/139 2020-11-20T11:16:33.862 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 84/139 2020-11-20T11:16:33.862 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 85/139 2020-11-20T11:16:33.862 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 86/139 2020-11-20T11:16:33.862 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 87/139 2020-11-20T11:16:33.863 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 88/139 2020-11-20T11:16:33.863 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 89/139 2020-11-20T11:16:33.863 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 90/139 2020-11-20T11:16:33.863 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 91/139 2020-11-20T11:16:33.863 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 92/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 93/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 94/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 95/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 96/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 97/139 2020-11-20T11:16:33.864 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 98/139 2020-11-20T11:16:33.865 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.1-6.el8.noarch 99/139 2020-11-20T11:16:33.865 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 100/139 2020-11-20T11:16:33.865 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 101/139 2020-11-20T11:16:33.865 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.5-12.el8.x86_64 102/139 2020-11-20T11:16:33.866 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 103/139 2020-11-20T11:16:33.866 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/139 2020-11-20T11:16:33.866 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 105/139 2020-11-20T11:16:33.866 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 106/139 2020-11-20T11:16:33.866 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 107/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 108/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 110/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/139 2020-11-20T11:16:33.867 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 113/139 2020-11-20T11:16:33.868 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.1-9.el8.x86_64 114/139 2020-11-20T11:16:33.868 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 115/139 2020-11-20T11:16:33.868 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.0.4-10.el8.x86_64 116/139 2020-11-20T11:16:33.868 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 117/139 2020-11-20T11:16:33.868 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 118/139 2020-11-20T11:16:33.869 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 119/139 2020-11-20T11:16:33.869 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 120/139 2020-11-20T11:16:33.869 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 121/139 2020-11-20T11:16:33.869 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 122/139 2020-11-20T11:16:33.869 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 123/139 2020-11-20T11:16:33.870 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 124/139 2020-11-20T11:16:33.870 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 125/139 2020-11-20T11:16:33.870 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 126/139 2020-11-20T11:16:33.870 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 127/139 2020-11-20T11:16:33.870 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:33.871 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:16:33.871 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:16:33.871 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:16:33.871 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:16:33.871 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:16:33.872 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:16:33.872 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:16:33.872 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:16:33.872 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:33.872 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:16:33.975 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:16:34.130 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:16:34.364 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:34.367 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:16:34.582 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:16:34.780 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:34.810 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:35.058 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T11:16:35.119 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:16:35.272 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:16:35.296 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:16:35.328 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:16:35.538 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:16:35.556 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:16:35.648 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:16:35.649 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:35.789 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:16:35.789 INFO:teuthology.orchestra.run.smithi204.stdout:Installed products updated. 2020-11-20T11:16:35.865 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:16:35.987 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:35.987 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:35.993 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:16:36.299 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T11:16:36.430 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:36.430 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T11:16:36.624 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:36.625 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:36.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T11:16:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:16:36.978 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:16:37.170 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:16:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:16:37.433 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:37.434 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:16:37.434 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:16:37.434 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:16:37.434 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:16:37.435 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:16:37.435 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:16:37.435 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:16:37.435 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:16:37.435 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:16:37.436 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:16:37.436 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:16:37.436 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:16:37.436 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:16:37.437 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:16:37.437 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:16:37.437 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:16:37.437 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:16:37.437 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:16:37.438 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:16:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:16:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:16:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:16:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:16:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:16:37.448 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:16:37.448 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:16:37.448 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:16:37.448 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:16:37.449 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:16:37.449 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:16:37.449 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:16:37.449 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:16:37.450 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:16:37.450 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:16:37.450 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:16:37.451 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:16:37.451 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:16:37.451 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:16:37.451 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:16:37.451 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:16:37.452 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:16:37.452 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:16:37.452 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:16:37.452 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:16:37.452 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:16:37.453 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:16:37.453 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:16:37.453 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:16:37.453 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:16:37.453 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:16:37.454 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:16:37.454 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:16:37.454 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:16:37.454 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:16:37.455 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:16:37.455 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:16:37.455 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:16:37.455 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:16:37.455 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:16:37.456 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:16:37.456 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:16:37.456 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:16:37.456 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:16:37.456 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:16:37.457 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:16:37.457 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T11:16:37.457 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T11:16:37.457 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T11:16:37.457 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T11:16:37.458 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T11:16:37.458 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T11:16:37.458 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T11:16:37.458 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T11:16:37.458 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T11:16:37.459 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T11:16:37.459 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T11:16:37.459 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T11:16:37.459 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T11:16:37.459 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T11:16:37.460 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T11:16:37.460 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T11:16:37.460 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T11:16:37.460 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T11:16:37.460 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T11:16:37.461 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T11:16:37.461 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T11:16:37.461 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T11:16:37.461 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T11:16:37.461 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T11:16:37.462 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T11:16:37.462 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T11:16:37.462 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T11:16:37.462 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T11:16:37.462 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T11:16:37.463 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T11:16:37.464 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T11:16:37.464 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T11:16:37.464 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T11:16:37.464 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T11:16:37.464 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T11:16:37.465 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T11:16:37.465 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T11:16:37.465 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T11:16:37.465 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T11:16:37.465 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T11:16:37.466 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T11:16:37.466 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T11:16:37.466 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T11:16:37.466 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T11:16:37.466 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T11:16:37.467 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T11:16:37.467 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T11:16:37.467 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T11:16:37.467 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T11:16:37.467 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T11:16:37.468 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T11:16:37.468 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T11:16:37.468 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:37.468 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:16:37.468 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:16:37.469 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:16:37.469 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:16:37.469 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:16:37.469 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:16:37.469 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:16:37.470 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:16:37.470 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:37.470 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:16:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:37.715 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:16:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:16:38.170 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T11:16:38.178 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:38.178 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2020-11-20T11:16:38.178 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:38.179 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:38.179 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:38.179 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:38.179 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.180 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.180 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:38.180 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2020-11-20T11:16:38.180 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:16:38.181 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:16:38.181 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.181 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.181 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.181 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.182 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.182 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.182 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.182 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.182 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.183 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.183 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.183 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.183 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.183 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.184 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.184 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.184 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.184 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.184 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.185 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:38.185 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:16:38.185 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:16:38.185 INFO:teuthology.orchestra.run.smithi204.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:16:38.185 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:16:38.186 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:16:38.186 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:16:38.186 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:16:38.186 INFO:teuthology.orchestra.run.smithi204.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:16:38.186 INFO:teuthology.orchestra.run.smithi204.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:16:38.187 INFO:teuthology.orchestra.run.smithi204.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:16:38.187 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:16:38.187 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.187 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.187 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:16:38.188 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:38.188 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:16:38.188 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:38.188 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:16:38.188 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.189 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.189 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:16:38.189 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.189 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:16:38.190 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:16:38.190 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:16:38.190 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:16:38.190 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:16:38.190 INFO:teuthology.orchestra.run.smithi204.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:16:38.191 INFO:teuthology.orchestra.run.smithi204.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:16:38.191 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:16:38.191 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:16:38.191 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:16:38.191 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:16:38.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:16:38.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:16:38.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:16:38.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:16:38.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:16:38.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.194 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.194 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.194 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:16:38.194 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:16:38.194 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:16:38.195 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:16:38.195 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:16:38.195 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:16:38.195 INFO:teuthology.orchestra.run.smithi204.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:16:38.196 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:16:38.197 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:16:38.197 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:16:38.197 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:16:38.197 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:16:38.197 INFO:teuthology.orchestra.run.smithi204.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:16:38.198 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:16:38.198 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:16:38.198 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:16:38.198 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:38.198 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:38.199 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:16:38.199 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:16:38.199 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:16:38.199 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:16:38.199 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:16:38.200 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:16:38.200 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:16:38.200 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:16:38.200 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:16:38.200 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.201 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.201 INFO:teuthology.orchestra.run.smithi204.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:16:38.201 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:16:38.201 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:16:38.201 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.202 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:16:38.202 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:16:38.202 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:16:38.202 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:16:38.202 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:16:38.203 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:16:38.204 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:16:38.204 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:16:38.204 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:16:38.204 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.204 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.205 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:38.205 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:16:38.205 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:16:38.205 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:16:38.205 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:16:38.206 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:38.206 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2020-11-20T11:16:38.379 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:16:38.392 DEBUG:teuthology.parallel:result is None 2020-11-20T11:16:38.442 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:16:38.645 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:16:38.669 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:16:38.780 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:16:38.781 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:39.006 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:16:39.106 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:16:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:39.127 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:39.554 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:16:39.554 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-20T11:16:39.575 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:39.575 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:39.798 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:16:39.799 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:16:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:16:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:16:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:16:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:16:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:16:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:16:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:16:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:16:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:16:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:16:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:16:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:16:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:16:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:16:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:16:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:16:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:16:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:16:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:16:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:16:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:16:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:16:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:16:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:16:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:16:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:16:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:16:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:16:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:16:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:16:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:16:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:16:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:16:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:16:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:16:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:16:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:16:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:16:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:16:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:16:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:16:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:16:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:16:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:16:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:16:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:16:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:16:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:16:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:16:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:16:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T11:16:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T11:16:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T11:16:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T11:16:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T11:16:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T11:16:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T11:16:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T11:16:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T11:16:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T11:16:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T11:16:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T11:16:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T11:16:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T11:16:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T11:16:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T11:16:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T11:16:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T11:16:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T11:16:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T11:16:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T11:16:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T11:16:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T11:16:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T11:16:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T11:16:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T11:16:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T11:16:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T11:16:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T11:16:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T11:16:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T11:16:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T11:16:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T11:16:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T11:16:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T11:16:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T11:16:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T11:16:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T11:16:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T11:16:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T11:16:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T11:16:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T11:16:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T11:16:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:16:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:16:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:16:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:16:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:16:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:16:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:16:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:16:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:16:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:16:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:41.978 INFO:teuthology.orchestra.run.smithi166.stdout:Upgraded: 2020-11-20T11:16:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:41.979 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-20T11:16:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:16:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:16:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:16:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:16:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:16:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:16:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:16:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:16:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:16:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:16:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:16:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:16:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:16:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:16:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:16:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:16:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:16:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:16:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:16:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:16:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:16:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:16:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:16:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:16:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:16:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:16:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:16:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:16:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:16:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:16:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:16:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:16:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:16:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:16:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:16:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:16:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:16:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:16:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:16:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:16:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:16:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:16:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:16:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:16:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:16:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:16:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:16:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:16:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:16:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:16:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:16:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:16:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:16:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:16:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:16:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:16:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:16:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:16:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:16:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:16:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:16:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:16:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:16:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:16:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:16:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:16:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:16:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:16:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:16:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:16:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:16:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:16:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:16:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:16:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:16:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:16:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:16:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:16:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:16:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:16:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:16:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:16:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:16:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:16:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:16:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:16:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:16:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:16:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:16:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:42.006 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-20T11:16:42.234 DEBUG:teuthology.parallel:result is None 2020-11-20T11:16:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:16:42.672 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2020-11-20T11:16:45.025 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:45.026 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2020-11-20T11:16:45.026 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:45.027 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:45.027 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:45.027 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:16:45.027 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.028 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.028 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:45.028 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2020-11-20T11:16:45.028 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:16:45.029 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:16:45.029 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.029 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.029 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.029 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.030 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.030 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.030 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.030 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.030 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.031 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.031 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.031 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.031 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.032 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.032 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.032 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.032 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.033 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.033 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.033 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:16:45.033 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:16:45.033 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:16:45.034 INFO:teuthology.orchestra.run.smithi112.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:16:45.034 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:16:45.034 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:16:45.034 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:16:45.034 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:16:45.035 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:16:45.035 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:16:45.035 INFO:teuthology.orchestra.run.smithi112.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:16:45.035 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:16:45.036 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.036 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.036 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:16:45.036 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:45.037 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:16:45.037 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:16:45.037 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:16:45.037 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.038 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.038 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:16:45.038 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.038 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:16:45.038 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:16:45.039 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:16:45.039 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:16:45.039 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:16:45.039 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:16:45.039 INFO:teuthology.orchestra.run.smithi112.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:16:45.040 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:16:45.040 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:16:45.040 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:16:45.040 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:16:45.040 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:16:45.041 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:16:45.041 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:16:45.041 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:16:45.041 INFO:teuthology.orchestra.run.smithi112.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:16:45.041 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:16:45.042 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:16:45.042 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:16:45.042 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:16:45.043 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:16:45.043 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.043 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.043 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.043 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:16:45.044 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:16:45.044 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:16:45.044 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:16:45.044 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:16:45.044 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:16:45.045 INFO:teuthology.orchestra.run.smithi112.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:16:45.045 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:16:45.045 INFO:teuthology.orchestra.run.smithi112.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:16:45.045 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:16:45.046 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:16:45.046 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:16:45.046 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:16:45.046 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:16:45.046 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:16:45.047 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:16:45.047 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:16:45.047 INFO:teuthology.orchestra.run.smithi112.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:16:45.047 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:16:45.048 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:16:45.048 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:16:45.048 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:45.048 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:16:45.049 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:16:45.049 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:16:45.049 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:16:45.049 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:16:45.049 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:16:45.050 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:16:45.050 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:16:45.050 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:16:45.050 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:16:45.050 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.051 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.051 INFO:teuthology.orchestra.run.smithi112.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:16:45.051 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:16:45.051 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:16:45.051 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.052 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:16:45.052 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:16:45.052 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:16:45.052 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:16:45.053 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:16:45.053 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:16:45.053 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:16:45.053 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:16:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:16:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:16:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:16:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:16:45.054 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:16:45.055 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:16:45.055 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.055 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.055 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:16:45.055 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:16:45.056 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:16:45.056 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:16:45.056 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:16:45.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:45.057 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2020-11-20T11:16:45.270 DEBUG:teuthology.parallel:result is None 2020-11-20T11:16:45.270 INFO:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2020-11-20T11:16:45.313 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2020-11-20T11:16:45.314 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:16:45.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:16:45.475 INFO:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:16:45.494 INFO:teuthology.orchestra.run.smithi112.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.495 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.495 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:16:45.496 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-20T11:16:45.547 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-20T11:16:45.548 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:16:45.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:16:45.708 INFO:teuthology.orchestra.run.smithi166:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:16:45.731 INFO:teuthology.orchestra.run.smithi166.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.731 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.732 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:16:45.732 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-11-20T11:16:45.783 INFO:teuthology.orchestra.run.smithi204.stdout:RedHatEnterprise 2020-11-20T11:16:45.784 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:16:45.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:16:45.949 INFO:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:16:45.972 INFO:teuthology.orchestra.run.smithi204.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.973 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:16:45.974 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:16:45.974 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T11:16:45.975 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:45.975 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:45.998 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:46.008 INFO:teuthology.orchestra.run.smithi112.stderr:24+1 records in 2020-11-20T11:16:46.008 INFO:teuthology.orchestra.run.smithi112.stderr:24+1 records out 2020-11-20T11:16:46.008 INFO:teuthology.orchestra.run.smithi112.stderr:12667 bytes (13 kB, 12 KiB) copied, 6.7796e-05 s, 187 MB/s 2020-11-20T11:16:46.009 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:46.010 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:46.035 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:46.046 INFO:teuthology.orchestra.run.smithi166.stderr:24+1 records in 2020-11-20T11:16:46.046 INFO:teuthology.orchestra.run.smithi166.stderr:24+1 records out 2020-11-20T11:16:46.047 INFO:teuthology.orchestra.run.smithi166.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.8864e-05 s, 161 MB/s 2020-11-20T11:16:46.048 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:46.048 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:46.072 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:16:46.084 INFO:teuthology.orchestra.run.smithi204.stderr:24+1 records in 2020-11-20T11:16:46.084 INFO:teuthology.orchestra.run.smithi204.stderr:24+1 records out 2020-11-20T11:16:46.084 INFO:teuthology.orchestra.run.smithi204.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.6601e-05 s, 165 MB/s 2020-11-20T11:16:46.085 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T11:16:46.086 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:46.086 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.100 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.110 INFO:teuthology.orchestra.run.smithi112.stderr:5+1 records in 2020-11-20T11:16:46.110 INFO:teuthology.orchestra.run.smithi112.stderr:5+1 records out 2020-11-20T11:16:46.110 INFO:teuthology.orchestra.run.smithi112.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 3.2873e-05 s, 93.0 MB/s 2020-11-20T11:16:46.111 INFO:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:16:46.193 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:46.194 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.226 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.243 INFO:teuthology.orchestra.run.smithi166.stderr:5+1 records in 2020-11-20T11:16:46.244 INFO:teuthology.orchestra.run.smithi166.stderr:5+1 records out 2020-11-20T11:16:46.246 INFO:teuthology.orchestra.run.smithi166.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.1761e-05 s, 73.2 MB/s 2020-11-20T11:16:46.248 INFO:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:16:46.317 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:46.318 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.343 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:16:46.353 INFO:teuthology.orchestra.run.smithi204.stderr:5+1 records in 2020-11-20T11:16:46.353 INFO:teuthology.orchestra.run.smithi204.stderr:5+1 records out 2020-11-20T11:16:46.354 INFO:teuthology.orchestra.run.smithi204.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 6.1159e-05 s, 50.0 MB/s 2020-11-20T11:16:46.355 INFO:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:16:46.429 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T11:16:46.430 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:46.430 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:299 bytes copied, 2.7406e-05 s, 10.9 MB/s 2020-11-20T11:16:46.462 INFO:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:16:46.540 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:46.540 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.559 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.571 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:16:46.571 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:16:46.572 INFO:teuthology.orchestra.run.smithi166.stderr:299 bytes copied, 3.5161e-05 s, 8.5 MB/s 2020-11-20T11:16:46.573 INFO:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:16:46.646 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:46.647 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.671 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:16:46.682 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:16:46.682 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:16:46.683 INFO:teuthology.orchestra.run.smithi204.stderr:299 bytes copied, 3.1341e-05 s, 9.5 MB/s 2020-11-20T11:16:46.684 INFO:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:16:46.765 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T11:16:46.830 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T11:16:46.831 INFO:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2020-11-20T11:16:46.843 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 777 /var/log/ceph 2020-11-20T11:16:46.849 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2020-11-20T11:16:46.886 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T11:16:46.887 INFO:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:16:46.923 INFO:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:16:46.933 INFO:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:16:46.972 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T11:16:46.973 INFO:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:16:47.002 INFO:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:16:47.009 INFO:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:16:47.725 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T11:16:47.725 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T11:16:47.726 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T11:16:47.726 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:47.726 INFO:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:47.744 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:47.746 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:47.747 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:47.747 INFO:teuthology.orchestra.run.smithi112.stderr:408 bytes copied, 0.0014077 s, 290 kB/s 2020-11-20T11:16:47.747 INFO:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:47.858 INFO:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:47.884 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:47.884 INFO:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:47.902 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:47.903 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:16:47.903 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:16:47.904 INFO:teuthology.orchestra.run.smithi166.stderr:408 bytes copied, 7.9889e-05 s, 5.1 MB/s 2020-11-20T11:16:47.904 INFO:teuthology.orchestra.run.smithi166:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:48.015 INFO:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:48.042 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:48.042 INFO:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:48.059 INFO:teuthology.orchestra.run.smithi204.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:16:48.060 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:16:48.060 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:16:48.061 INFO:teuthology.orchestra.run.smithi204.stderr:408 bytes copied, 3.3763e-05 s, 12.1 MB/s 2020-11-20T11:16:48.061 INFO:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:48.172 INFO:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:16:48.205 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T11:16:48.206 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T11:16:48.206 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640209', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.6040', 'targets': {'smithi112.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRe8BvPiGkqMhsyU0T+xryfH62+QXI/VYa2uYoox2OXfDH6Q9ebQqZ0YNQeVh0mRspHAze4SVD6GMb6UpbOWPxrQDqh3BO80Bsg/YbdYe1nAoXJIoYPVZ7hTy1YJl4ovftbVENTZGLE+36D05N4+H+9paz3nqAHRu/U+h+u77YE+LJ2xH0hOO02Ov4bVfmGkaVO5Ay/LKcyllSvDr03MFPSdBN67hbR64a+rAAgpk4Q5/0msuTAZfFZJtTSINPj8AHnO2ORf9qe9HnNkGeJB+2369JCD1X3IvIMh8EFtBDsRJtKim65dZSs2MJy+jBbWt8PsdLfD8FQfQQROsTfQMY9hFaD6AiTe8gERmoU74v+EUVimvRZ8fGSNsfRFP1cDB/FiZ4o/1ZqoBY/L7Dm3XLYX4FCSRkh409gQen15tUcV2fdWTBOu8GV7kOdINzp3UexElLSC2Tfs/Pqt9dB4DnCHwFWyiHhLJX2Dn3H6vnMPTW8JuxlRSvqc2zhvz9Tis=', 'smithi166.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtfZhUIbZXPfjpfyjjxQvL0IIgRz3Y2nEkY7N+DiwEDQ0zNk+gu80ej0O24lfLrbdiAcTpjfPDSzIVcPHpLXce7diiXfiRWygIXE6prtEStj5+WPlWceJyr+fn3Es1s2SoHiIJuZcwzFI0qDDLWUFxrr8KX3LfuSx89UQd0sow9eUSDUghS/pQDgtFUATAXalGxiSCqSsHL11WTm6L6vMurjXm98WIv8oRjVn1HimIYUgC8gMbD+EHhcLXDSMcd97g2KCkH5zeThQPcGRt0wiBYX/G2mJ1jSFbDh82EYz0HR7nLZgCSnZfVAiD2m25ehmMoYpoasd9RVS0lPV9M6dNOAWLQQIoiNHKc9bGO7+aJUR6l71RI38maypP0dMg3IHFU2JE8r/BT13N9YGeDzjKCFO8N0DNkrJ+IRzL6hJBI3TPVnNbr6l9EkvGM1afrlns0sgULjKZOv4tKVis3aUXn+Ay80I8oDv0SId6KTHC+RKTAEaHytaXz12vcwXiEyc=', 'smithi204.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0Id0dUhAWfhF2dpWSMnVRvPzH9VtSLhC4VA8nc2ApMc/pPbSlcW7CQxIwbdBNvvk1RMQZgEZysEyct8Fb5Mo6iLSuFo1lVnmLiY/X5fNlRkjTpJRg3BrZ+IFbBUflYnJOzml1cvXtexaLJaXy5fJhZO4Wpv8+Z8fRIbyeebcfFFaAlryUD4JSVmqrAol8gjYxoe/MAcx0GPvUriceJ0PuPYZvAsV0TTfpak7CP16z+3CPVs/R3f4sQjaAo2TZIQ/2B1aRRiWTJ/OMfSOmRqfd+QxMMVU5VgwttZMHKRhdsML675oUJps7Q5G8Kzk3s1f1m6xcw5aTp4HgY3zoe5vuS/aUxHVgl8gNVTyBDbUGtUdlWC6AZ1zP6uqN0ShFXHONmv/8MjhA5YG2yChdZMs8/jO1iw7gZTwe8EXd5/db3bR8XgSmRe5hX3H3yuQPlj60s8RUAVb6OgVCZaTEKQZMpOPYtTW26bJuB3O43aI2M14OR8I6Z43OxM/LdfzrV2k='}} 2020-11-20T11:16:48.207 INFO:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:16:48.210 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:16:48.212 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:16:48.254 INFO:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:16:48.265 INFO:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:16:48.267 INFO:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:16:48.319 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:48.320 INFO:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.342 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:16:48.342 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:16:48.342 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:16:48.342 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:16:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:72 bytes copied, 3.198e-05 s, 2.3 MB/s 2020-11-20T11:16:48.343 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:16:48.344 INFO:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:16:48.396 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:16:48.397 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 58933 Links: 1 2020-11-20T11:16:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2020-11-20 11:16:40.255505844 +0000 2020-11-20T11:16:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2020-11-20 11:14:27.230022555 +0000 2020-11-20T11:16:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2020-11-20 11:14:27.230022555 +0000 2020-11-20T11:16:48.398 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2020-11-20T11:16:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2020-11-20T11:16:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2020-11-20T11:16:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000259262 s, 2.0 MB/s 2020-11-20T11:16:48.409 INFO:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:16:48.463 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:16:48.464 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.464 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 59069 Links: 1 2020-11-20T11:16:48.464 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.464 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.464 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2020-11-20 11:16:40.255505844 +0000 2020-11-20T11:16:48.465 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2020-11-20 11:14:27.560013706 +0000 2020-11-20T11:16:48.465 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2020-11-20 11:14:27.560013706 +0000 2020-11-20T11:16:48.465 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2020-11-20T11:16:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2020-11-20T11:16:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2020-11-20T11:16:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000249533 s, 2.1 MB/s 2020-11-20T11:16:48.475 INFO:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:16:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:16:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 53172 Links: 1 2020-11-20T11:16:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2020-11-20 11:16:40.255505844 +0000 2020-11-20T11:16:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2020-11-20 11:14:27.887004937 +0000 2020-11-20T11:16:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2020-11-20 11:14:27.887004937 +0000 2020-11-20T11:16:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2020-11-20T11:16:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2020-11-20T11:16:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2020-11-20T11:16:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000213231 s, 2.4 MB/s 2020-11-20T11:16:48.541 INFO:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:16:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:16:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.596 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 59887 Links: 1 2020-11-20T11:16:48.596 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.596 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.597 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2020-11-20 11:16:40.255505844 +0000 2020-11-20T11:16:48.597 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2020-11-20 11:14:28.210996249 +0000 2020-11-20T11:16:48.597 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2020-11-20 11:14:28.210996249 +0000 2020-11-20T11:16:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2020-11-20T11:16:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2020-11-20T11:16:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2020-11-20T11:16:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000216643 s, 2.4 MB/s 2020-11-20T11:16:48.607 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:48.608 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:48.608 INFO:teuthology.orchestra.run.smithi166:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.624 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.625 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:16:48.625 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:16:48.626 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:16:48.626 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:16:48.626 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:16:48.626 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:16:48.627 INFO:teuthology.orchestra.run.smithi166.stderr:72 bytes copied, 3.5236e-05 s, 2.0 MB/s 2020-11-20T11:16:48.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:16:48.627 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:16:48.683 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:16:48.683 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.683 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 59598 Links: 1 2020-11-20T11:16:48.684 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.684 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.684 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-20 11:16:37.070701701 +0000 2020-11-20T11:16:48.684 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-20 11:14:33.982963108 +0000 2020-11-20T11:16:48.685 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-20 11:14:33.982963108 +0000 2020-11-20T11:16:48.685 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-20T11:16:48.694 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-20T11:16:48.694 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-20T11:16:48.695 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.00027173 s, 1.9 MB/s 2020-11-20T11:16:48.697 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:16:48.753 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:16:48.754 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.754 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 54180 Links: 1 2020-11-20T11:16:48.754 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.754 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.755 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-20 11:16:37.070701701 +0000 2020-11-20T11:16:48.755 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-20 11:14:34.297956842 +0000 2020-11-20T11:16:48.755 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-20 11:14:34.297956842 +0000 2020-11-20T11:16:48.755 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-20T11:16:48.764 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-20T11:16:48.764 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-20T11:16:48.764 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000239146 s, 2.1 MB/s 2020-11-20T11:16:48.767 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:16:48.822 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:16:48.822 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.823 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 54235 Links: 1 2020-11-20T11:16:48.823 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.823 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.823 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-20 11:16:37.070701701 +0000 2020-11-20T11:16:48.824 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-20 11:14:34.619950436 +0000 2020-11-20T11:16:48.824 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-20 11:14:34.619950436 +0000 2020-11-20T11:16:48.824 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-20T11:16:48.832 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-20T11:16:48.833 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-20T11:16:48.833 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.0002395 s, 2.1 MB/s 2020-11-20T11:16:48.835 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:16:48.891 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:16:48.891 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.891 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 56824 Links: 1 2020-11-20T11:16:48.892 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.892 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.892 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-20 11:16:37.070701701 +0000 2020-11-20T11:16:48.892 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-20 11:14:34.943943991 +0000 2020-11-20T11:16:48.893 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-20 11:14:34.943943991 +0000 2020-11-20T11:16:48.893 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-20T11:16:48.901 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-20T11:16:48.901 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-20T11:16:48.902 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000214401 s, 2.4 MB/s 2020-11-20T11:16:48.903 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:48.904 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:48.904 INFO:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.920 INFO:teuthology.orchestra.run.smithi204.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:16:48.921 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:16:48.922 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:16:48.922 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:16:48.922 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:16:48.922 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:16:48.923 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:16:48.923 INFO:teuthology.orchestra.run.smithi204.stderr:72 bytes copied, 3.5695e-05 s, 2.0 MB/s 2020-11-20T11:16:48.923 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:16:48.923 INFO:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:16:48.978 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:16:48.979 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:48.979 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 6h/6d Inode: 56860 Links: 1 2020-11-20T11:16:48.979 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:48.980 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:48.980 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2020-11-20 11:16:33.490693568 +0000 2020-11-20T11:16:48.980 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2020-11-20 11:14:33.725843829 +0000 2020-11-20T11:16:48.980 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2020-11-20 11:14:33.725843829 +0000 2020-11-20T11:16:48.980 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2020-11-20T11:16:48.990 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2020-11-20T11:16:48.990 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2020-11-20T11:16:48.990 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000266622 s, 1.9 MB/s 2020-11-20T11:16:48.993 INFO:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:16:49.050 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:16:49.051 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:49.051 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 6h/6d Inode: 57799 Links: 1 2020-11-20T11:16:49.051 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:49.052 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:49.052 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2020-11-20 11:16:33.490693568 +0000 2020-11-20T11:16:49.052 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2020-11-20 11:14:34.060839510 +0000 2020-11-20T11:16:49.052 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2020-11-20 11:14:34.060839510 +0000 2020-11-20T11:16:49.053 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2020-11-20T11:16:49.061 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2020-11-20T11:16:49.061 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2020-11-20T11:16:49.062 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.00020882 s, 2.5 MB/s 2020-11-20T11:16:49.064 INFO:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:16:49.120 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:16:49.121 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:49.121 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 6h/6d Inode: 50818 Links: 1 2020-11-20T11:16:49.121 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2020-11-20 11:16:33.490693568 +0000 2020-11-20T11:16:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2020-11-20 11:14:34.366835564 +0000 2020-11-20T11:16:49.122 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2020-11-20 11:14:34.366835564 +0000 2020-11-20T11:16:49.123 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2020-11-20T11:16:49.131 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2020-11-20T11:16:49.131 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2020-11-20T11:16:49.131 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000274453 s, 1.9 MB/s 2020-11-20T11:16:49.133 INFO:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:16:49.189 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:16:49.189 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:16:49.189 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 6h/6d Inode: 58010 Links: 1 2020-11-20T11:16:49.190 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:16:49.190 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:16:49.190 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2020-11-20 11:16:33.490693568 +0000 2020-11-20T11:16:49.190 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2020-11-20 11:14:34.704831206 +0000 2020-11-20T11:16:49.191 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2020-11-20 11:14:34.704831206 +0000 2020-11-20T11:16:49.191 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2020-11-20T11:16:49.199 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2020-11-20T11:16:49.199 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2020-11-20T11:16:49.200 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000214689 s, 2.4 MB/s 2020-11-20T11:16:49.202 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:49.202 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:16:49.203 INFO:tasks.ceph:Generating config... 2020-11-20T11:16:49.204 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T11:16:49.204 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T11:16:49.205 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T11:16:49.205 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T11:16:49.205 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T11:16:49.206 INFO:tasks.ceph:[global] ms die on skipped message = False 2020-11-20T11:16:49.206 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T11:16:49.206 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T11:16:49.207 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T11:16:49.207 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T11:16:49.207 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T11:16:49.208 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T11:16:49.209 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T11:16:49.209 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T11:16:49.209 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T11:16:49.210 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T11:16:49.210 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T11:16:49.210 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T11:16:49.210 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T11:16:49.211 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T11:16:49.211 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T11:16:49.211 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T11:16:49.212 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T11:16:49.212 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T11:16:49.212 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T11:16:49.212 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T11:16:49.213 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T11:16:49.213 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T11:16:49.213 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T11:16:49.214 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T11:16:49.214 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T11:16:49.214 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T11:16:49.215 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T11:16:49.215 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T11:16:49.215 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T11:16:49.215 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T11:16:49.216 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T11:16:49.216 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T11:16:49.216 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T11:16:49.217 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T11:16:49.217 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T11:16:49.217 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T11:16:49.217 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2020-11-20T11:16:49.218 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T11:16:49.218 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T11:16:49.279 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T11:16:49.282 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T11:16:49.321 INFO:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:49.386 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.166'), ('mon.c', '172.21.15.204')] 2020-11-20T11:16:49.387 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.166,172.21.15.204', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T11:16:49.389 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:49.389 INFO:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:16:49.438 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:16:49.440 INFO:teuthology.orchestra.run.smithi112.stderr:6+1 records in 2020-11-20T11:16:49.440 INFO:teuthology.orchestra.run.smithi112.stderr:6+1 records out 2020-11-20T11:16:49.440 INFO:teuthology.orchestra.run.smithi112.stderr:3502 bytes (3.5 kB, 3.4 KiB) copied, 3.9033e-05 s, 89.7 MB/s 2020-11-20T11:16:49.441 INFO:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.166 --add c 172.21.15.204 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:49.521 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:49.522 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 3ec2328c-34d0-493f-8c83-5fdcfe44cc78 2020-11-20T11:16:49.522 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2020-11-20T11:16:49.523 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 3ec2328c-34d0-493f-8c83-5fdcfe44cc78 2020-11-20T11:16:49.523 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2020-11-20T11:16:49.519690+0000 2020-11-20T11:16:49.523 INFO:teuthology.orchestra.run.smithi112.stdout:created 2020-11-20T11:16:49.519690+0000 2020-11-20T11:16:49.524 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 0 (unknown) 2020-11-20T11:16:49.524 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2020-11-20T11:16:49.525 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2020-11-20T11:16:49.525 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] mon.b 2020-11-20T11:16:49.526 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.c 2020-11-20T11:16:49.526 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T11:16:49.528 INFO:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:16:49.582 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3ec2328c-34d0-493f-8c83-5fdcfe44cc78... 2020-11-20T11:16:49.583 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:16:49.625 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:16:49.627 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:16:49.664 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2020-11-20T11:16:49.664 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2020-11-20T11:16:49.664 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:16:49.665 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2020-11-20T11:16:49.665 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.665 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2020-11-20T11:16:49.665 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.665 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2020-11-20T11:16:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2020-11-20T11:16:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2020-11-20T11:16:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.666 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2020-11-20T11:16:49.667 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2020-11-20T11:16:49.667 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.667 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:16:49.667 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2020-11-20T11:16:49.667 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.668 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:16:49.668 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:16:49.668 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.668 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2020-11-20T11:16:49.668 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2020-11-20T11:16:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2020-11-20T11:16:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:16:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:16:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2020-11-20T11:16:49.670 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:16:49.670 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2020-11-20T11:16:49.670 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:16:49.670 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:16:49.670 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2020-11-20T11:16:49.671 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.671 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:16:49.671 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.671 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2020-11-20T11:16:49.671 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.672 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2020-11-20T11:16:49.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.672 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2020-11-20T11:16:49.672 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2020-11-20T11:16:49.672 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2020-11-20T11:16:49.673 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.166,172.21.15.204" 2020-11-20T11:16:49.673 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2020-11-20T11:16:49.673 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 3ec2328c-34d0-493f-8c83-5fdcfe44cc78 2020-11-20T11:16:49.673 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.674 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2020-11-20T11:16:49.674 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2020-11-20T11:16:49.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.674 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2020-11-20T11:16:49.674 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2020-11-20T11:16:49.675 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2020-11-20T11:16:49.676 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2020-11-20T11:16:49.676 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.676 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2020-11-20T11:16:49.676 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2020-11-20T11:16:49.676 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.677 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:16:49.677 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.677 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2020-11-20T11:16:49.677 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.678 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2020-11-20T11:16:49.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.678 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:16:49.678 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2020-11-20T11:16:49.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2020-11-20T11:16:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2020-11-20T11:16:49.680 INFO:teuthology.orchestra.run.smithi112.stdout: debug filestore = 20 2020-11-20T11:16:49.680 INFO:teuthology.orchestra.run.smithi112.stdout: debug journal = 20 2020-11-20T11:16:49.680 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 20 2020-11-20T11:16:49.680 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 25 2020-11-20T11:16:49.680 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2020-11-20T11:16:49.681 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:16:49.681 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2020-11-20T11:16:49.681 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:16:49.681 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:16:49.682 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2020-11-20T11:16:49.682 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2020-11-20T11:16:49.682 INFO:teuthology.orchestra.run.smithi112.stdout: osd shutdown pgref assert = True 2020-11-20T11:16:49.682 INFO:teuthology.orchestra.run.smithi112.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:16:49.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.683 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2020-11-20T11:16:49.683 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2020-11-20T11:16:49.683 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2020-11-20T11:16:49.683 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2020-11-20T11:16:49.683 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2020-11-20T11:16:49.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.684 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2020-11-20T11:16:49.684 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.684 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2020-11-20T11:16:49.685 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2020-11-20T11:16:49.685 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2020-11-20T11:16:49.685 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2020-11-20T11:16:49.685 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2020-11-20T11:16:49.685 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.686 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2020-11-20T11:16:49.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:16:49.687 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2020-11-20T11:16:49.687 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2020-11-20T11:16:49.687 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2020-11-20T11:16:49.687 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2020-11-20T11:16:49.688 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:16:49.688 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:16:49.688 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2020-11-20T11:16:49.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2020-11-20T11:16:49.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2020-11-20T11:16:49.689 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.689 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.689 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2020-11-20T11:16:49.689 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2020-11-20T11:16:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2020-11-20T11:16:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2020-11-20T11:16:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2020-11-20T11:16:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2020-11-20T11:16:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2020-11-20T11:16:49.691 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2020-11-20T11:16:49.691 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2020-11-20T11:16:49.691 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal frag = True 2020-11-20T11:16:49.691 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal fragment size max = 10000 2020-11-20T11:16:49.691 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal merge size = 5 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split bits = 3 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split size = 100 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2020-11-20T11:16:49.692 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2020-11-20T11:16:49.693 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2020-11-20T11:16:49.693 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.693 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.695 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2020-11-20T11:16:49.695 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2020-11-20T11:16:49.696 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:16:49.696 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2020-11-20T11:16:49.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.696 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2020-11-20T11:16:49.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.697 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2020-11-20T11:16:49.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.697 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2020-11-20T11:16:49.697 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2020-11-20T11:16:49.697 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.698 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2020-11-20T11:16:49.698 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2020-11-20T11:16:49.698 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.698 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:16:49.698 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2020-11-20T11:16:49.699 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.699 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:16:49.699 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:16:49.699 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.699 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2020-11-20T11:16:49.700 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.700 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2020-11-20T11:16:49.700 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2020-11-20T11:16:49.700 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:16:49.700 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:16:49.701 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2020-11-20T11:16:49.701 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:16:49.701 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2020-11-20T11:16:49.701 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:16:49.701 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:16:49.702 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2020-11-20T11:16:49.702 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.702 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:16:49.702 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.702 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2020-11-20T11:16:49.703 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.703 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2020-11-20T11:16:49.703 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.703 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2020-11-20T11:16:49.703 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2020-11-20T11:16:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2020-11-20T11:16:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.112,172.21.15.166,172.21.15.204" 2020-11-20T11:16:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on skipped message = False 2020-11-20T11:16:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 3ec2328c-34d0-493f-8c83-5fdcfe44cc78 2020-11-20T11:16:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.705 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2020-11-20T11:16:49.705 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2020-11-20T11:16:49.705 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.705 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2020-11-20T11:16:49.705 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2020-11-20T11:16:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2020-11-20T11:16:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2020-11-20T11:16:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.706 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2020-11-20T11:16:49.707 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2020-11-20T11:16:49.707 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2020-11-20T11:16:49.707 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.707 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2020-11-20T11:16:49.707 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2020-11-20T11:16:49.708 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.708 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:16:49.708 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.708 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2020-11-20T11:16:49.708 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.709 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2020-11-20T11:16:49.709 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.709 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:16:49.709 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2020-11-20T11:16:49.709 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.710 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2020-11-20T11:16:49.710 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2020-11-20T11:16:49.710 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2020-11-20T11:16:49.710 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2020-11-20T11:16:49.710 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug filestore = 20 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug journal = 20 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 20 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 25 2020-11-20T11:16:49.711 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2020-11-20T11:16:49.712 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:16:49.712 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2020-11-20T11:16:49.712 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:16:49.712 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:16:49.712 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2020-11-20T11:16:49.713 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2020-11-20T11:16:49.713 INFO:teuthology.orchestra.run.smithi204.stdout: osd shutdown pgref assert = True 2020-11-20T11:16:49.713 INFO:teuthology.orchestra.run.smithi204.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:16:49.713 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.713 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2020-11-20T11:16:49.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-11-20T11:16:49.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2020-11-20T11:16:49.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2020-11-20T11:16:49.714 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2020-11-20T11:16:49.714 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.715 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.715 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2020-11-20T11:16:49.715 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.715 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2020-11-20T11:16:49.715 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-11-20T11:16:49.716 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2020-11-20T11:16:49.716 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2020-11-20T11:16:49.716 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2020-11-20T11:16:49.716 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2020-11-20T11:16:49.716 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2020-11-20T11:16:49.717 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.717 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2020-11-20T11:16:49.717 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2020-11-20T11:16:49.717 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.717 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2020-11-20T11:16:49.718 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-11-20T11:16:49.718 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2020-11-20T11:16:49.718 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2020-11-20T11:16:49.718 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2020-11-20T11:16:49.718 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2020-11-20T11:16:49.719 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:16:49.719 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:16:49.719 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2020-11-20T11:16:49.719 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2020-11-20T11:16:49.719 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-11-20T11:16:49.720 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.720 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.720 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2020-11-20T11:16:49.720 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2020-11-20T11:16:49.720 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2020-11-20T11:16:49.721 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2020-11-20T11:16:49.721 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2020-11-20T11:16:49.721 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2020-11-20T11:16:49.721 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2020-11-20T11:16:49.721 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2020-11-20T11:16:49.722 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-11-20T11:16:49.722 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal frag = True 2020-11-20T11:16:49.722 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal fragment size max = 10000 2020-11-20T11:16:49.722 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal merge size = 5 2020-11-20T11:16:49.722 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal split bits = 3 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal split size = 100 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2020-11-20T11:16:49.723 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2020-11-20T11:16:49.724 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.724 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.724 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2020-11-20T11:16:49.724 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2020-11-20T11:16:49.725 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:16:49.725 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2020-11-20T11:16:49.725 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.725 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2020-11-20T11:16:49.725 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.726 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2020-11-20T11:16:49.726 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.726 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2020-11-20T11:16:49.726 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2020-11-20T11:16:49.726 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.727 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2020-11-20T11:16:49.727 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2020-11-20T11:16:49.727 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.727 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:16:49.727 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2020-11-20T11:16:49.728 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.728 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:16:49.728 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:16:49.728 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.728 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2020-11-20T11:16:49.729 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.729 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2020-11-20T11:16:49.729 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2020-11-20T11:16:49.729 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:16:49.729 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:16:49.730 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2020-11-20T11:16:49.730 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:16:49.730 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2020-11-20T11:16:49.730 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:16:49.730 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:16:49.731 INFO:teuthology.orchestra.run.smithi166.stdout: mon_allow_pool_size_one = true 2020-11-20T11:16:49.731 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.731 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:16:49.731 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.731 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2020-11-20T11:16:49.732 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.732 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2020-11-20T11:16:49.732 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.732 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2020-11-20T11:16:49.732 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2020-11-20T11:16:49.733 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2020-11-20T11:16:49.733 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.112,172.21.15.166,172.21.15.204" 2020-11-20T11:16:49.733 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on skipped message = False 2020-11-20T11:16:49.733 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = 3ec2328c-34d0-493f-8c83-5fdcfe44cc78 2020-11-20T11:16:49.733 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.734 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2020-11-20T11:16:49.734 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2020-11-20T11:16:49.734 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.734 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2020-11-20T11:16:49.734 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 600 2020-11-20T11:16:49.735 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.735 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2020-11-20T11:16:49.735 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2020-11-20T11:16:49.735 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.735 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2020-11-20T11:16:49.736 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.737 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:16:49.737 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.737 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2020-11-20T11:16:49.737 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.738 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2020-11-20T11:16:49.738 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.738 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:16:49.738 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2020-11-20T11:16:49.738 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.739 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2020-11-20T11:16:49.739 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2020-11-20T11:16:49.739 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2020-11-20T11:16:49.739 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2020-11-20T11:16:49.739 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 20 2020-11-20T11:16:49.740 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 20 2020-11-20T11:16:49.740 INFO:teuthology.orchestra.run.smithi166.stdout: debug filestore = 20 2020-11-20T11:16:49.740 INFO:teuthology.orchestra.run.smithi166.stdout: debug journal = 20 2020-11-20T11:16:49.740 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 20 2020-11-20T11:16:49.740 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 25 2020-11-20T11:16:49.741 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 10 2020-11-20T11:16:49.741 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:16:49.741 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2020-11-20T11:16:49.741 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:16:49.741 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:16:49.742 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2020-11-20T11:16:49.742 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2020-11-20T11:16:49.742 INFO:teuthology.orchestra.run.smithi166.stdout: osd shutdown pgref assert = True 2020-11-20T11:16:49.742 INFO:teuthology.orchestra.run.smithi166.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:16:49.742 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2020-11-20T11:16:49.743 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.744 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.744 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2020-11-20T11:16:49.744 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.744 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2020-11-20T11:16:49.744 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-20T11:16:49.745 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2020-11-20T11:16:49.745 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2020-11-20T11:16:49.745 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2020-11-20T11:16:49.745 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2020-11-20T11:16:49.745 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2020-11-20T11:16:49.746 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:16:49.746 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2020-11-20T11:16:49.746 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2020-11-20T11:16:49.746 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:16:49.746 INFO:teuthology.orchestra.run.smithi166.stdout: mon op complaint time = 120 2020-11-20T11:16:49.747 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-20T11:16:49.747 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2020-11-20T11:16:49.747 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2020-11-20T11:16:49.747 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2020-11-20T11:16:49.747 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2020-11-20T11:16:49.748 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:16:49.748 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:16:49.748 INFO:teuthology.orchestra.run.smithi166.stdout: client mount timeout = 600 2020-11-20T11:16:49.748 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2020-11-20T11:16:49.748 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-20T11:16:49.749 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.749 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.749 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2020-11-20T11:16:49.749 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2020-11-20T11:16:49.749 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2020-11-20T11:16:49.750 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2020-11-20T11:16:49.750 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2020-11-20T11:16:49.750 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2020-11-20T11:16:49.750 INFO:teuthology.orchestra.run.smithi166.stdout:[mds] 2020-11-20T11:16:49.750 INFO:teuthology.orchestra.run.smithi166.stdout: debug mds = 20 2020-11-20T11:16:49.751 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-20T11:16:49.751 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal frag = True 2020-11-20T11:16:49.751 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal fragment size max = 10000 2020-11-20T11:16:49.751 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal merge size = 5 2020-11-20T11:16:49.751 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split bits = 3 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split size = 100 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug frag = True 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug scatterstat = True 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: mds op complaint time = 180 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: mds verify scatter = True 2020-11-20T11:16:49.752 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2020-11-20T11:16:49.753 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2020-11-20T11:16:49.753 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2020-11-20T11:16:49.753 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T11:16:49.754 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T11:16:49.842 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T11:16:49.843 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:49.843 INFO:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:16:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:16:49.857 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.] 2020-11-20T11:16:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQChpbdfUKHuEhAAHK3zGRL30ruy/9e77EONYw== 2020-11-20T11:16:49.858 INFO:teuthology.orchestra.run.smithi112.stdout:[client.admin] 2020-11-20T11:16:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQChpbdficmhLxAAaHsJCS5lZ1/Q4yjVDCzfiA== 2020-11-20T11:16:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow *" 2020-11-20T11:16:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: caps mgr = "allow *" 2020-11-20T11:16:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow *" 2020-11-20T11:16:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow *" 2020-11-20T11:16:49.859 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:49.859 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:49.859 INFO:teuthology.orchestra.run.smithi112.stderr:206 bytes copied, 2.7378e-05 s, 7.5 MB/s 2020-11-20T11:16:49.860 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:49.860 INFO:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:16:49.910 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:16:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: �>�2�4�I?��_��D�x���_A�����_A���aXa �p��pbXb �����cXc �����abc 2020-11-20T11:16:49.911 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:49.911 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:49.912 INFO:teuthology.orchestra.run.smithi112.stderr:409 bytes copied, 2.7458e-05 s, 14.9 MB/s 2020-11-20T11:16:49.912 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:16:49.912 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:49.913 INFO:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:49.913 INFO:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:49.964 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:50.011 INFO:teuthology.orchestra.run.smithi112.stderr:206 bytes copied, 0.0365877 s, 5.6 kB/s 2020-11-20T11:16:50.011 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:50.021 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:16:50.022 INFO:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.034 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.088 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:16:50.089 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:16:50.089 INFO:teuthology.orchestra.run.smithi112.stderr:409 bytes copied, 0.0527828 s, 7.7 kB/s 2020-11-20T11:16:50.089 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:16:50.090 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:50.090 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:50.091 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:50.107 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:50.118 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:16:50.118 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:16:50.118 INFO:teuthology.orchestra.run.smithi166.stderr:206 bytes copied, 3.4671e-05 s, 5.9 MB/s 2020-11-20T11:16:50.119 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:50.130 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:16:50.131 INFO:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.186 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.187 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:16:50.187 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:16:50.188 INFO:teuthology.orchestra.run.smithi166.stderr:409 bytes copied, 3.4066e-05 s, 12.0 MB/s 2020-11-20T11:16:50.188 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:16:50.189 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:50.189 INFO:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:50.189 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:50.205 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:16:50.216 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:16:50.217 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:16:50.217 INFO:teuthology.orchestra.run.smithi204.stderr:206 bytes copied, 3.4401e-05 s, 6.0 MB/s 2020-11-20T11:16:50.217 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:16:50.229 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:16:50.230 INFO:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.284 INFO:teuthology.orchestra.run.smithi204.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:50.285 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:16:50.285 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:16:50.286 INFO:teuthology.orchestra.run.smithi204.stderr:409 bytes copied, 3.2781e-05 s, 12.5 MB/s 2020-11-20T11:16:50.286 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T11:16:50.286 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T11:16:50.287 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:16:50.339 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:16:50.341 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:16:50.409 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:16:50.412 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:16:50.477 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:16:50.479 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T11:16:50.480 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:16:50.532 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:16:50.534 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T11:16:50.560 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:16:50.614 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:16:50.617 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T11:16:50.644 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:16:50.697 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:16:50.699 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T11:16:50.724 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T11:16:50.726 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T11:16:50.764 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T11:16:50.776 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T11:16:50.777 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:16:50.777 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T11:16:50.840 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:50.841 INFO:tasks.ceph:role: osd.0 2020-11-20T11:16:50.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:16:50.842 INFO:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:16:50.911 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:16:50.912 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:16:50.912 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:16:50.912 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2020-11-20T11:16:50.912 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:16:50.913 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:16:50.913 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:16:50.913 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:16:50.913 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:16:50.914 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:16:51.275 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2020-11-20T11:16:51.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2020-11-20T11:16:51.277 INFO:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T11:16:51.400 INFO:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T11:16:51.427 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T11:16:51.492 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:51.492 INFO:tasks.ceph:role: osd.3 2020-11-20T11:16:51.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:16:51.493 INFO:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:16:51.563 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:16:51.564 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:16:51.564 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:16:51.564 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2020-11-20T11:16:51.565 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:16:51.565 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:16:51.565 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:16:51.566 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:16:51.566 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:16:51.566 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:16:51.930 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2020-11-20T11:16:51.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2020-11-20T11:16:51.932 INFO:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T11:16:52.021 INFO:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T11:16:52.049 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T11:16:52.113 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:52.114 INFO:tasks.ceph:role: osd.6 2020-11-20T11:16:52.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:16:52.115 INFO:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2020-11-20T11:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:16:52.550 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2020-11-20T11:16:52.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2020-11-20T11:16:52.552 INFO:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T11:16:52.652 INFO:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T11:16:52.679 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T11:16:52.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:16:52.743 INFO:tasks.ceph:role: osd.9 2020-11-20T11:16:52.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:16:52.744 INFO:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:16:52.814 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:16:52.814 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:16:52.814 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:16:52.815 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2020-11-20T11:16:52.815 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:16:52.815 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:16:52.815 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:16:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:16:52.816 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:16:52.816 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:16:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2020-11-20T11:16:53.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2020-11-20T11:16:53.192 INFO:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T11:16:53.298 INFO:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T11:16:53.326 INFO:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:53.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.406+0000 7f220d5b7f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T11:16:53.410 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.408+0000 7f220d5b7f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T11:16:53.410 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.408+0000 7f220d5b7f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:16:53.410 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.408+0000 7f220d5b7f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:16:53.411 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.408+0000 7f220d5b7f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:16:53.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:53.410+0000 7f220d5b7f40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T11:16:56.256 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T11:16:56.325 INFO:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:56.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T11:16:56.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T11:16:56.413 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:16:56.413 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:16:56.413 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:16:56.413 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:56.410+0000 7f2b28bcbf40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T11:16:59.251 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T11:16:59.284 INFO:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:16:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.369+0000 7f0e18b7cf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T11:16:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.369+0000 7f0e18b7cf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T11:16:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.369+0000 7f0e18b7cf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:16:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.369+0000 7f0e18b7cf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:16:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.369+0000 7f0e18b7cf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:16:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:16:59.370+0000 7f0e18b7cf40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T11:17:02.215 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T11:17:02.284 INFO:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.368+0000 7f2f8a48df40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T11:17:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.369+0000 7f2f8a48df40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T11:17:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.369+0000 7f2f8a48df40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:17:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.369+0000 7f2f8a48df40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:17:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.369+0000 7f2f8a48df40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:17:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:02.369+0000 7f2f8a48df40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2020-11-20T11:17:05.213 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T11:17:05.242 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T11:17:05.272 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:05.272 INFO:tasks.ceph:role: osd.1 2020-11-20T11:17:05.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:17:05.273 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:17:05.347 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-20T11:17:05.348 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:05.348 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:05.348 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:05.349 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:05.708 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-20T11:17:05.710 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-20T11:17:05.710 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T11:17:05.846 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T11:17:05.878 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T11:17:05.945 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:05.946 INFO:tasks.ceph:role: osd.4 2020-11-20T11:17:05.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:17:05.946 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:17:06.018 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:06.019 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:06.019 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:06.019 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-20T11:17:06.019 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:06.020 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:06.020 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:06.020 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:06.020 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:06.020 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:06.374 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-20T11:17:06.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-20T11:17:06.376 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T11:17:06.466 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T11:17:06.496 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T11:17:06.561 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:06.561 INFO:tasks.ceph:role: osd.7 2020-11-20T11:17:06.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:17:06.562 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:17:06.632 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:06.633 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:06.633 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:06.633 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-20T11:17:06.634 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:06.634 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:06.634 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:06.634 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:06.634 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:06.635 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:06.996 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-20T11:17:06.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-20T11:17:06.998 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T11:17:07.104 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T11:17:07.131 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T11:17:07.195 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:07.196 INFO:tasks.ceph:role: osd.10 2020-11-20T11:17:07.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:17:07.196 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:17:07.266 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:07.267 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:07.267 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:07.267 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-20T11:17:07.267 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:07.268 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:07.268 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:07.268 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:07.268 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:07.268 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:07.642 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-20T11:17:07.644 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-20T11:17:07.644 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T11:17:07.738 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T11:17:07.765 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:07.845 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.844+0000 7f4a7df99f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T11:17:07.847 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.845+0000 7f4a7df99f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T11:17:07.847 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.845+0000 7f4a7df99f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:17:07.848 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.846+0000 7f4a7df99f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:17:07.848 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.846+0000 7f4a7df99f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:17:07.854 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:07.853+0000 7f4a7df99f40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T11:17:10.699 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T11:17:10.767 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:10.853 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.851+0000 7f6cccdd4f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T11:17:10.853 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.851+0000 7f6cccdd4f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T11:17:10.854 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.851+0000 7f6cccdd4f40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:17:10.854 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.851+0000 7f6cccdd4f40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:17:10.854 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.851+0000 7f6cccdd4f40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:17:10.855 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:10.852+0000 7f6cccdd4f40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T11:17:13.699 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T11:17:13.729 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:13.818 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T11:17:13.818 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T11:17:13.818 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:17:13.819 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:17:13.819 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:17:13.819 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:13.816+0000 7f74abcd5f40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T11:17:16.662 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T11:17:16.703 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:16.803 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T11:17:16.803 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T11:17:16.804 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:17:16.804 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:17:16.804 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:17:16.804 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-20T11:17:16.800+0000 7f1a55d36f40 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2020-11-20T11:17:18.209 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:18.212 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:18.214 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:19.644 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T11:17:19.672 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T11:17:19.701 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:19.701 INFO:tasks.ceph:role: osd.2 2020-11-20T11:17:19.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:17:19.702 INFO:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:17:19.776 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:19.776 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:19.776 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:19.776 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 2020-11-20T11:17:19.777 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:19.777 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:19.777 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:19.777 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:19.778 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:19.778 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:20.145 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2020-11-20T11:17:20.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2020-11-20T11:17:20.147 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T11:17:20.275 INFO:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T11:17:20.306 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T11:17:20.372 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:20.372 INFO:tasks.ceph:role: osd.5 2020-11-20T11:17:20.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:17:20.373 INFO:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:17:20.445 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:20.446 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 2020-11-20T11:17:20.446 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:20.446 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:20.446 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:20.446 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:20.447 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:20.447 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:20.803 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2020-11-20T11:17:20.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2020-11-20T11:17:20.805 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T11:17:20.892 INFO:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T11:17:20.922 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T11:17:20.988 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:20.988 INFO:tasks.ceph:role: osd.8 2020-11-20T11:17:20.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:17:20.989 INFO:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:17:21.060 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:21.061 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:21.061 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:21.061 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 2020-11-20T11:17:21.061 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:21.061 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:21.062 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:21.425 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2020-11-20T11:17:21.427 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2020-11-20T11:17:21.427 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T11:17:21.534 INFO:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T11:17:21.564 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T11:17:21.629 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:17:21.630 INFO:tasks.ceph:role: osd.11 2020-11-20T11:17:21.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:17:21.631 INFO:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:17:21.701 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:17:21.701 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:17:21.701 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:17:21.702 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 2020-11-20T11:17:21.702 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:17:21.702 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:17:21.702 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:17:21.702 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:17:21.703 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:17:21.703 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:17:22.074 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2020-11-20T11:17:22.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2020-11-20T11:17:22.076 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T11:17:22.174 INFO:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T11:17:22.202 INFO:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:22.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.281+0000 7f0754f23f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T11:17:22.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.282+0000 7f0754f23f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T11:17:22.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.282+0000 7f0754f23f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:17:22.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.282+0000 7f0754f23f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:17:22.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.282+0000 7f0754f23f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:17:22.289 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:22.288+0000 7f0754f23f40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T11:17:25.130 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T11:17:25.197 INFO:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:25.281 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.278+0000 7f4557715f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T11:17:25.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.279+0000 7f4557715f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T11:17:25.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.279+0000 7f4557715f40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:17:25.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.279+0000 7f4557715f40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:17:25.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.279+0000 7f4557715f40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:17:25.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:25.279+0000 7f4557715f40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T11:17:28.120 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T11:17:28.189 INFO:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:28.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.272+0000 7fe6509aff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T11:17:28.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.272+0000 7fe6509aff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T11:17:28.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.272+0000 7fe6509aff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:17:28.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.272+0000 7fe6509aff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:17:28.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.272+0000 7fe6509aff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:17:28.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:28.273+0000 7fe6509aff40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2020-11-20T11:17:31.122 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T11:17:31.151 INFO:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:31.238 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.235+0000 7fc802909f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T11:17:31.239 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.236+0000 7fc802909f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T11:17:31.239 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.236+0000 7fc802909f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:17:31.239 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.236+0000 7fc802909f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:17:31.240 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.236+0000 7fc802909f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:17:31.240 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:31.236+0000 7fc802909f40 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2020-11-20T11:17:34.093 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T11:17:34.122 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T11:17:34.122 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.123 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:17:34.139 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:17:34.150 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2020-11-20T11:17:34.150 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfZEUlFBAA4SPEtmQFQpLwuMZuN7NoqA== 2020-11-20T11:17:34.150 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.150 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.151 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 5.9103e-05 s, 947 kB/s 2020-11-20T11:17:34.152 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.152 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:17:34.206 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:17:34.216 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2020-11-20T11:17:34.217 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfQWOnHxAA/GRqfQNeshB3l9KaQkWfFA== 2020-11-20T11:17:34.217 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.217 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.217 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 7.4217e-05 s, 755 kB/s 2020-11-20T11:17:34.218 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.219 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:17:34.272 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:17:34.282 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2020-11-20T11:17:34.283 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQClpbdfFtg7GBAAOqDssOm2uyj1AqGOB7tVSQ== 2020-11-20T11:17:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 3.203e-05 s, 1.7 MB/s 2020-11-20T11:17:34.284 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.285 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:17:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:17:34.348 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2020-11-20T11:17:34.349 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCopbdfRbR0GBAALMFREmk2H35ntxxf6DnprA== 2020-11-20T11:17:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.349 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.350 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 3.0438e-05 s, 1.8 MB/s 2020-11-20T11:17:34.351 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.351 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:17:34.404 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:17:34.414 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2020-11-20T11:17:34.414 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCrpbdfNMcaFhAATGBqtNgvebAsxr6juJxxTw== 2020-11-20T11:17:34.414 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.414 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.415 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 2.9747e-05 s, 1.9 MB/s 2020-11-20T11:17:34.416 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:34.416 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:17:34.469 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:17:34.478 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.9] 2020-11-20T11:17:34.479 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCupbdfGcIQFhAAk1ZtWFs9AwJf0IN7Nvbbdw== 2020-11-20T11:17:34.479 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:34.480 INFO:teuthology.orchestra.run.smithi112.stderr:56 bytes copied, 2.8543e-05 s, 2.0 MB/s 2020-11-20T11:17:34.481 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.482 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:17:34.498 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:17:34.509 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.y] 2020-11-20T11:17:34.510 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfCAhOGBAAJM7rqbAG+P+1wVVBmXq9aA== 2020-11-20T11:17:34.510 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.511 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.511 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 4.567e-05 s, 1.2 MB/s 2020-11-20T11:17:34.512 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.513 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:17:34.567 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:17:34.578 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2020-11-20T11:17:34.578 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdf3kmSJBAAcGUvNnZvzyuQfKUNk+vf/A== 2020-11-20T11:17:34.579 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.579 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.579 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 4.3061e-05 s, 1.3 MB/s 2020-11-20T11:17:34.580 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.580 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:17:34.635 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:17:34.645 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.1] 2020-11-20T11:17:34.645 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCzpbdf0gtYMhAA5SQnJLpSVAwOeHxoCZ3lbg== 2020-11-20T11:17:34.646 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.646 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.646 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 3.72e-05 s, 1.5 MB/s 2020-11-20T11:17:34.647 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.647 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:17:34.701 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:17:34.711 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.4] 2020-11-20T11:17:34.712 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC2pbdfdi/FMhAAji1u0rYpiTziVcVvJ/Y0mw== 2020-11-20T11:17:34.712 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.712 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.712 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 3.3361e-05 s, 1.7 MB/s 2020-11-20T11:17:34.713 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.714 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:17:34.767 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:17:34.778 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.7] 2020-11-20T11:17:34.778 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC5pbdflfepMBAAchzIVi6TlKnzXHi8jA6lmg== 2020-11-20T11:17:34.778 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.778 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.779 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 3.6106e-05 s, 1.6 MB/s 2020-11-20T11:17:34.780 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:34.780 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:17:34.833 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:17:34.843 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.10] 2020-11-20T11:17:34.843 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC8pbdf/yfELxAAGsMDQOe8fK7n9Wvjlqj9RA== 2020-11-20T11:17:34.844 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:34.844 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:34.844 INFO:teuthology.orchestra.run.smithi166.stderr:57 bytes copied, 3.0434e-05 s, 1.9 MB/s 2020-11-20T11:17:34.845 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:34.846 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:17:34.861 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:17:34.873 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.z] 2020-11-20T11:17:34.873 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfFrRfHBAAczOOhT80zhPoKfMFBPpsoQ== 2020-11-20T11:17:34.873 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:34.874 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:34.874 INFO:teuthology.orchestra.run.smithi204.stderr:56 bytes copied, 4.2375e-05 s, 1.3 MB/s 2020-11-20T11:17:34.875 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:34.875 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:17:34.930 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:17:34.941 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2020-11-20T11:17:34.942 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfP692KRAAcPD2GAH9IgnCQAXXEEbtKg== 2020-11-20T11:17:34.942 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:34.942 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:34.942 INFO:teuthology.orchestra.run.smithi204.stderr:56 bytes copied, 4.0796e-05 s, 1.4 MB/s 2020-11-20T11:17:34.943 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:34.944 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:17:34.998 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:17:35.008 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2020-11-20T11:17:35.008 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDCpbdfDnjLEBAApqub7zh7kVzNI52MrCiWKQ== 2020-11-20T11:17:35.009 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:35.009 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:35.009 INFO:teuthology.orchestra.run.smithi204.stderr:56 bytes copied, 3.3635e-05 s, 1.7 MB/s 2020-11-20T11:17:35.010 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:35.011 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:17:35.064 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:17:35.074 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2020-11-20T11:17:35.075 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDFpbdf7zWuEBAAvLTjlDqGKSEkrBRKSA7yAw== 2020-11-20T11:17:35.075 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:35.076 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:35.077 INFO:teuthology.orchestra.run.smithi204.stderr:56 bytes copied, 3.5221e-05 s, 1.6 MB/s 2020-11-20T11:17:35.078 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:35.079 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:17:35.136 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:17:35.146 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.8] 2020-11-20T11:17:35.147 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDIpbdfv0tPEBAAMqZbVmmIHErg5uWMELJY8Q== 2020-11-20T11:17:35.147 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:35.147 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:35.147 INFO:teuthology.orchestra.run.smithi204.stderr:56 bytes copied, 3.2173e-05 s, 1.7 MB/s 2020-11-20T11:17:35.148 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:35.148 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:17:35.211 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:17:35.222 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.11] 2020-11-20T11:17:35.222 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDLpbdfe7ofDhAApzT9WABljYyxCNodL8+Meg== 2020-11-20T11:17:35.223 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:35.223 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:35.223 INFO:teuthology.orchestra.run.smithi204.stderr:57 bytes copied, 4.8121e-05 s, 1.2 MB/s 2020-11-20T11:17:35.224 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:35.224 INFO:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:17:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:17:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:59 bytes copied, 6.2356e-05 s, 946 kB/s 2020-11-20T11:17:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2020-11-20T11:17:35.249 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfTC52LRAA9vHvpw5OD0CJqscEwMG37w== 2020-11-20T11:17:35.250 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T11:17:35.250 INFO:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:17:35.300 INFO:teuthology.orchestra.run.smithi166:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:17:35.310 INFO:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:17:35.325 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2020-11-20T11:17:35.326 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfZEUlFBAA4SPEtmQFQpLwuMZuN7NoqA== 2020-11-20T11:17:35.326 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2020-11-20T11:17:35.326 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfQWOnHxAA/GRqfQNeshB3l9KaQkWfFA== 2020-11-20T11:17:35.326 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2020-11-20T11:17:35.327 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQClpbdfFtg7GBAAOqDssOm2uyj1AqGOB7tVSQ== 2020-11-20T11:17:35.327 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2020-11-20T11:17:35.327 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCopbdfRbR0GBAALMFREmk2H35ntxxf6DnprA== 2020-11-20T11:17:35.327 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2020-11-20T11:17:35.327 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCrpbdfNMcaFhAATGBqtNgvebAsxr6juJxxTw== 2020-11-20T11:17:35.328 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.9] 2020-11-20T11:17:35.328 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCupbdfGcIQFhAAk1ZtWFs9AwJf0IN7Nvbbdw== 2020-11-20T11:17:35.328 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2020-11-20T11:17:35.328 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfCAhOGBAAJM7rqbAG+P+1wVVBmXq9aA== 2020-11-20T11:17:35.328 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2020-11-20T11:17:35.329 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdf3kmSJBAAcGUvNnZvzyuQfKUNk+vf/A== 2020-11-20T11:17:35.329 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2020-11-20T11:17:35.329 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCzpbdf0gtYMhAA5SQnJLpSVAwOeHxoCZ3lbg== 2020-11-20T11:17:35.329 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2020-11-20T11:17:35.329 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQC2pbdfdi/FMhAAji1u0rYpiTziVcVvJ/Y0mw== 2020-11-20T11:17:35.330 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2020-11-20T11:17:35.330 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQC5pbdflfepMBAAchzIVi6TlKnzXHi8jA6lmg== 2020-11-20T11:17:35.330 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.10] 2020-11-20T11:17:35.330 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQC8pbdf/yfELxAAGsMDQOe8fK7n9Wvjlqj9RA== 2020-11-20T11:17:35.330 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.z] 2020-11-20T11:17:35.331 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfFrRfHBAAczOOhT80zhPoKfMFBPpsoQ== 2020-11-20T11:17:35.331 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2020-11-20T11:17:35.331 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfP692KRAAcPD2GAH9IgnCQAXXEEbtKg== 2020-11-20T11:17:35.331 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2020-11-20T11:17:35.331 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDCpbdfDnjLEBAApqub7zh7kVzNI52MrCiWKQ== 2020-11-20T11:17:35.332 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2020-11-20T11:17:35.332 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDFpbdf7zWuEBAAvLTjlDqGKSEkrBRKSA7yAw== 2020-11-20T11:17:35.332 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.8] 2020-11-20T11:17:35.332 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDIpbdfv0tPEBAAMqZbVmmIHErg5uWMELJY8Q== 2020-11-20T11:17:35.332 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.11] 2020-11-20T11:17:35.333 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDLpbdfe7ofDhAApzT9WABljYyxCNodL8+Meg== 2020-11-20T11:17:35.333 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2020-11-20T11:17:35.333 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCipbdfTC52LRAA9vHvpw5OD0CJqscEwMG37w== 2020-11-20T11:17:35.334 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.x] 2020-11-20T11:17:35.335 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfZEUlFBAA4SPEtmQFQpLwuMZuN7NoqA== 2020-11-20T11:17:35.335 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2020-11-20T11:17:35.335 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfQWOnHxAA/GRqfQNeshB3l9KaQkWfFA== 2020-11-20T11:17:35.335 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.0] 2020-11-20T11:17:35.336 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQClpbdfFtg7GBAAOqDssOm2uyj1AqGOB7tVSQ== 2020-11-20T11:17:35.336 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.3] 2020-11-20T11:17:35.336 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCopbdfRbR0GBAALMFREmk2H35ntxxf6DnprA== 2020-11-20T11:17:35.336 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.6] 2020-11-20T11:17:35.337 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCrpbdfNMcaFhAATGBqtNgvebAsxr6juJxxTw== 2020-11-20T11:17:35.337 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.9] 2020-11-20T11:17:35.337 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCupbdfGcIQFhAAk1ZtWFs9AwJf0IN7Nvbbdw== 2020-11-20T11:17:35.337 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.y] 2020-11-20T11:17:35.338 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfCAhOGBAAJM7rqbAG+P+1wVVBmXq9aA== 2020-11-20T11:17:35.338 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2020-11-20T11:17:35.338 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdf3kmSJBAAcGUvNnZvzyuQfKUNk+vf/A== 2020-11-20T11:17:35.338 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.1] 2020-11-20T11:17:35.338 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCzpbdf0gtYMhAA5SQnJLpSVAwOeHxoCZ3lbg== 2020-11-20T11:17:35.339 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.4] 2020-11-20T11:17:35.339 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC2pbdfdi/FMhAAji1u0rYpiTziVcVvJ/Y0mw== 2020-11-20T11:17:35.339 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.7] 2020-11-20T11:17:35.339 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC5pbdflfepMBAAchzIVi6TlKnzXHi8jA6lmg== 2020-11-20T11:17:35.339 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.10] 2020-11-20T11:17:35.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC8pbdf/yfELxAAGsMDQOe8fK7n9Wvjlqj9RA== 2020-11-20T11:17:35.340 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.z] 2020-11-20T11:17:35.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfFrRfHBAAczOOhT80zhPoKfMFBPpsoQ== 2020-11-20T11:17:35.340 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2020-11-20T11:17:35.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfP692KRAAcPD2GAH9IgnCQAXXEEbtKg== 2020-11-20T11:17:35.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.2] 2020-11-20T11:17:35.341 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDCpbdfDnjLEBAApqub7zh7kVzNI52MrCiWKQ== 2020-11-20T11:17:35.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.5] 2020-11-20T11:17:35.341 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDFpbdf7zWuEBAAvLTjlDqGKSEkrBRKSA7yAw== 2020-11-20T11:17:35.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.8] 2020-11-20T11:17:35.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDIpbdfv0tPEBAAMqZbVmmIHErg5uWMELJY8Q== 2020-11-20T11:17:35.342 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.11] 2020-11-20T11:17:35.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDLpbdfe7ofDhAApzT9WABljYyxCNodL8+Meg== 2020-11-20T11:17:35.342 INFO:teuthology.orchestra.run.smithi166.stdout:[client.0] 2020-11-20T11:17:35.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCipbdfTC52LRAA9vHvpw5OD0CJqscEwMG37w== 2020-11-20T11:17:35.344 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2020-11-20T11:17:35.344 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfZEUlFBAA4SPEtmQFQpLwuMZuN7NoqA== 2020-11-20T11:17:35.344 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2020-11-20T11:17:35.344 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfQWOnHxAA/GRqfQNeshB3l9KaQkWfFA== 2020-11-20T11:17:35.345 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2020-11-20T11:17:35.345 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQClpbdfFtg7GBAAOqDssOm2uyj1AqGOB7tVSQ== 2020-11-20T11:17:35.345 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2020-11-20T11:17:35.345 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCopbdfRbR0GBAALMFREmk2H35ntxxf6DnprA== 2020-11-20T11:17:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2020-11-20T11:17:35.346 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCrpbdfNMcaFhAATGBqtNgvebAsxr6juJxxTw== 2020-11-20T11:17:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.9] 2020-11-20T11:17:35.346 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCupbdfGcIQFhAAk1ZtWFs9AwJf0IN7Nvbbdw== 2020-11-20T11:17:35.346 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2020-11-20T11:17:35.347 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfCAhOGBAAJM7rqbAG+P+1wVVBmXq9aA== 2020-11-20T11:17:35.347 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2020-11-20T11:17:35.347 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdf3kmSJBAAcGUvNnZvzyuQfKUNk+vf/A== 2020-11-20T11:17:35.347 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2020-11-20T11:17:35.347 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCzpbdf0gtYMhAA5SQnJLpSVAwOeHxoCZ3lbg== 2020-11-20T11:17:35.348 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2020-11-20T11:17:35.348 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQC2pbdfdi/FMhAAji1u0rYpiTziVcVvJ/Y0mw== 2020-11-20T11:17:35.348 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2020-11-20T11:17:35.348 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQC5pbdflfepMBAAchzIVi6TlKnzXHi8jA6lmg== 2020-11-20T11:17:35.348 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.10] 2020-11-20T11:17:35.349 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQC8pbdf/yfELxAAGsMDQOe8fK7n9Wvjlqj9RA== 2020-11-20T11:17:35.349 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.z] 2020-11-20T11:17:35.349 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfFrRfHBAAczOOhT80zhPoKfMFBPpsoQ== 2020-11-20T11:17:35.349 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2020-11-20T11:17:35.349 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfP692KRAAcPD2GAH9IgnCQAXXEEbtKg== 2020-11-20T11:17:35.350 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2020-11-20T11:17:35.350 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDCpbdfDnjLEBAApqub7zh7kVzNI52MrCiWKQ== 2020-11-20T11:17:35.350 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2020-11-20T11:17:35.350 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDFpbdf7zWuEBAAvLTjlDqGKSEkrBRKSA7yAw== 2020-11-20T11:17:35.350 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.8] 2020-11-20T11:17:35.351 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDIpbdfv0tPEBAAMqZbVmmIHErg5uWMELJY8Q== 2020-11-20T11:17:35.351 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.11] 2020-11-20T11:17:35.351 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDLpbdfe7ofDhAApzT9WABljYyxCNodL8+Meg== 2020-11-20T11:17:35.351 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2020-11-20T11:17:35.351 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCipbdfTC52LRAA9vHvpw5OD0CJqscEwMG37w== 2020-11-20T11:17:35.352 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.381 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.389 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.436 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:35.441 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:35.449 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:35.531 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.538 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.547 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.618 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.627 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.638 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.709 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.718 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.726 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.803 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.815 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.819 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:35.895 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.910 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.915 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:35.985 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.000 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.004 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.057 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.064 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.068 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.116 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.154 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.164 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.213 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.242 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.252 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.302 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.334 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.342 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.394 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:36.430 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:36.436 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:17:36.485 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.520 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.525 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:17:36.585 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.613 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.627 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.680 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.699 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.711 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.767 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.771 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.796 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.855 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.858 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.860 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:17:36.906 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:17:36.943 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:17:36.946 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:17:36.993 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T11:17:36.994 INFO:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T11:17:37.017 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:17:37.107 INFO:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T11:17:37.131 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T11:17:37.155 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:17:37.245 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T11:17:37.269 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T11:17:37.294 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:17:37.387 INFO:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T11:17:37.412 INFO:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:37.415 INFO:teuthology.orchestra.run.smithi166:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:37.418 INFO:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:17:37.466 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T11:17:37.467 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T11:17:37.467 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T11:17:37.470 INFO:tasks.ceph.mon.a:Started 2020-11-20T11:17:37.470 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T11:17:37.470 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T11:17:37.473 INFO:tasks.ceph.mon.b:Started 2020-11-20T11:17:37.474 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T11:17:37.474 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T11:17:37.509 INFO:tasks.ceph.mon.c:Started 2020-11-20T11:17:37.509 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T11:17:37.510 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T11:17:37.510 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T11:17:37.512 INFO:tasks.ceph.mgr.x:Started 2020-11-20T11:17:37.513 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T11:17:37.513 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T11:17:37.516 INFO:tasks.ceph.mgr.y:Started 2020-11-20T11:17:37.517 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T11:17:37.517 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T11:17:37.520 INFO:tasks.ceph.mgr.z:Started 2020-11-20T11:17:37.520 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T11:17:37.521 INFO:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T11:17:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.649+0000 7ff192db9700 1 Processor -- start 2020-11-20T11:17:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.649+0000 7ff192db9700 1 -- start start 2020-11-20T11:17:37.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff192db9700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:37.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff192db9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff192db9700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0c5230 con 0x7ff18c065d30 2020-11-20T11:17:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff192db9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0bff40 con 0x7ff18c1512e0 2020-11-20T11:17:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff192db9700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c1549c0 con 0x7ff18c066110 2020-11-20T11:17:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49842/0 (socket says 172.21.15.112:49842) 2020-11-20T11:17:37.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 learned_addr learned my addr 172.21.15.112:0/382687945 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:37.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:37.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:37.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:37.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:17:37.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:37.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:17:37.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:37.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:37.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.650+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:17:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:17:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:17:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:37.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:37.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:37.851+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:17:38.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:38.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:17:38.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:38.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:38.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:17:38.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:38.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:38.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:38.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:38.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:38.252+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:17:39.056 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:39.056 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:17:39.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:39.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:39.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:17:39.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:39.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:39.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff18bfff700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:39.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:39.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:39.053+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:17:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 msgr2=0x7ff18c0bfa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:17:40.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.166:3300/0 conn(0x7ff18c066110 0x7ff18c0bfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:40.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 msgr2=0x7ff18c151710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:17:40.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.112:3300/0 conn(0x7ff18c1512e0 0x7ff18c151710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:40.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 >> v1:172.21.15.166:6789/0 conn(0x7ff18c065d30 legacy=0x7ff18c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:40.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:40.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c154c60 con 0x7ff174007070 2020-11-20T11:17:40.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17400ea00 con 0x7ff174003410 2020-11-20T11:17:40.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff18a7fc700 1 -- 172.21.15.112:0/382687945 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0bff40 con 0x7ff17400ade0 2020-11-20T11:17:40.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.650+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:40.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.651+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:40.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.651+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:40.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.651+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:40.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.651+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:17:40.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.852+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:40.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.852+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:40.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.852+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:40.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.852+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:40.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:40.852+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:17:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:41.253+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:41.253+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:41.253+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:41.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:41.253+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:41.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:41.253+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:17:42.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.054+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.054+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:17:42.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.054+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:17:42.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.054+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:17:42.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.055+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:17:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.812+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488532038 0 0) 0x7ff18c154c60 con 0x7ff174007070 2020-11-20T11:17:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.812+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff170003280 con 0x7ff174007070 2020-11-20T11:17:42.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270541927 0 0) 0x7ff17400ea00 con 0x7ff174003410 2020-11-20T11:17:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff18c154c60 con 0x7ff174003410 2020-11-20T11:17:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.2 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4192772555 0 0) 0x7ff18c154c60 con 0x7ff174003410 2020-11-20T11:17:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 msgr2=0x7ff17400d2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:17:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 --2- 172.21.15.112:0/382687945 >> v2:172.21.15.204:3300/0 conn(0x7ff17400ade0 0x7ff17400d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 >> v1:172.21.15.112:6789/0 conn(0x7ff174007070 legacy=0x7ff174009510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17400fd20 con 0x7ff174003410 2020-11-20T11:17:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff191356700 1 -- 172.21.15.112:0/382687945 reap_dead start 2020-11-20T11:17:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.2 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7ff180001560 con 0x7ff174003410 2020-11-20T11:17:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 >> v1:172.21.15.204:6789/0 conn(0x7ff174003410 legacy=0x7ff174005840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff170003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff1700049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff17000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0bff40 con 0x7ff170003900 2020-11-20T11:17:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17000bc60 con 0x7ff170004e90 2020-11-20T11:17:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17000be20 con 0x7ff170004520 2020-11-20T11:17:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff190b55700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff170003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.813+0000 7ff191356700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff17000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff18bfff700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff1700049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 -- 172.21.15.112:0/382687945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 msgr2=0x7ff1700049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff1700049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 -- 172.21.15.112:0/382687945 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 msgr2=0x7ff17000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff17000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 -- 172.21.15.112:0/382687945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c154c60 con 0x7ff170003900 2020-11-20T11:17:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.814+0000 7ff190b55700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff170003d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff18000c320 tx=0x7ff180007740).ready entity=mon.0 client_cookie=660ccc2b8c2ef7ff server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.815+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180009070 con 0x7ff170003900 2020-11-20T11:17:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.815+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180001a20 con 0x7ff170003900 2020-11-20T11:17:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.815+0000 7ff18b7fe700 1 -- 172.21.15.112:0/382687945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180001de0 con 0x7ff170003900 2020-11-20T11:17:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.815+0000 7ff192db9700 1 -- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 msgr2=0x7ff170003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.815+0000 7ff192db9700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff170003d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff18000c320 tx=0x7ff180007740).stop 2020-11-20T11:17:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 -- 172.21.15.112:0/382687945 shutdown_connections 2020-11-20T11:17:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff1700049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff170003d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 --2- 172.21.15.112:0/382687945 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff17000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 -- 172.21.15.112:0/382687945 >> 172.21.15.112:0/382687945 conn(0x7ff18c05bac0 msgr2=0x7ff18c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:42.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 -- 172.21.15.112:0/382687945 shutdown_connections 2020-11-20T11:17:42.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.816+0000 7ff192db9700 1 -- 172.21.15.112:0/382687945 wait complete. 2020-11-20T11:17:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.817+0000 7ff192db9700 1 Processor -- start 2020-11-20T11:17:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.818+0000 7ff192db9700 1 -- start start 2020-11-20T11:17:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.818+0000 7ff192db9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.818+0000 7ff192db9700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff18c14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff192db9700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff18c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff192db9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c14c810 con 0x7ff170003900 2020-11-20T11:17:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff192db9700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c14cab0 con 0x7ff170004e90 2020-11-20T11:17:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff192db9700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c14cd50 con 0x7ff170004520 2020-11-20T11:17:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49914/0 (socket says 172.21.15.112:49914) 2020-11-20T11:17:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 -- 172.21.15.112:0/1255749590 learned_addr learned my addr 172.21.15.112:0/1255749590 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff18bfff700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff18c14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.831 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff191356700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff18c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:42.831 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 -- 172.21.15.112:0/1255749590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 msgr2=0x7ff18c14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.831 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff18c14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.831 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 -- 172.21.15.112:0/1255749590 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 msgr2=0x7ff18c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.831 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff18c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.832 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 -- 172.21.15.112:0/1255749590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c14cff0 con 0x7ff170003900 2020-11-20T11:17:42.832 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.819+0000 7ff190b55700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff180001180 tx=0x7ff180007740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:42.832 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.820+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180000e90 con 0x7ff170003900 2020-11-20T11:17:42.832 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18001c430 con 0x7ff170003900 2020-11-20T11:17:42.832 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c163730 con 0x7ff170003900 2020-11-20T11:17:42.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18001c7b0 con 0x7ff170003900 2020-11-20T11:17:42.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c160220 con 0x7ff170003900 2020-11-20T11:17:42.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff18001cbe0 con 0x7ff170003900 2020-11-20T11:17:42.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.821+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff1800267d0 con 0x7ff170003900 2020-11-20T11:17:42.834 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.822+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0666e0 con 0x7ff170003900 2020-11-20T11:17:42.834 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.824+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ff180015070 con 0x7ff170003900 2020-11-20T11:17:42.901 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.898+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff18c0666e0 con 0x7ff170003900 2020-11-20T11:17:42.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.905+0000 7ff188ff9700 1 -- 172.21.15.112:0/1255749590 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff180007dc0 con 0x7ff170003900 2020-11-20T11:17:42.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 msgr2=0x7ff18c14a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:42.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff180001180 tx=0x7ff180007740).stop 2020-11-20T11:17:42.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 shutdown_connections 2020-11-20T11:17:42.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff170004e90 0x7ff18c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff170003900 0x7ff18c14a5a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 --2- 172.21.15.112:0/1255749590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff170004520 0x7ff18c14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:42.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 >> 172.21.15.112:0/1255749590 conn(0x7ff18c05bac0 msgr2=0x7ff18c0c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:42.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 shutdown_connections 2020-11-20T11:17:42.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:42.906+0000 7ff192db9700 1 -- 172.21.15.112:0/1255749590 wait complete. 2020-11-20T11:17:42.911 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2020-11-20T11:17:42.920 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T11:17:42.921 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:42.921 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:17:42.934 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:17:42.944 INFO:teuthology.orchestra.run.smithi112.stdout:54aafbc8-d5e6-489d-a1da-e00066837aa9 2020-11-20T11:17:42.945 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:42.945 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:42.945 INFO:teuthology.orchestra.run.smithi112.stderr:37 bytes copied, 3.3547e-05 s, 1.1 MB/s 2020-11-20T11:17:42.946 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:42.947 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:17:42.999 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:17:43.009 INFO:teuthology.orchestra.run.smithi112.stdout:91f91662-644d-4bab-b8a0-2149ada31978 2020-11-20T11:17:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:43.010 INFO:teuthology.orchestra.run.smithi112.stderr:37 bytes copied, 3.2508e-05 s, 1.1 MB/s 2020-11-20T11:17:43.011 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:43.011 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:17:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:17:43.073 INFO:teuthology.orchestra.run.smithi112.stdout:c101d1b8-188b-4a96-a6c8-327b3d6e4b74 2020-11-20T11:17:43.073 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:43.073 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:43.074 INFO:teuthology.orchestra.run.smithi112.stderr:37 bytes copied, 2.968e-05 s, 1.2 MB/s 2020-11-20T11:17:43.075 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:17:43.075 INFO:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:17:43.127 INFO:teuthology.orchestra.run.smithi112.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:17:43.137 INFO:teuthology.orchestra.run.smithi112.stdout:3edbfb9c-833c-4d50-9268-fc07ce6430be 2020-11-20T11:17:43.137 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2020-11-20T11:17:43.137 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2020-11-20T11:17:43.138 INFO:teuthology.orchestra.run.smithi112.stderr:37 bytes copied, 2.9382e-05 s, 1.3 MB/s 2020-11-20T11:17:43.139 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:43.139 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:17:43.152 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:17:43.163 INFO:teuthology.orchestra.run.smithi166.stdout:708a3e7b-2c3b-45db-8333-c571a5fe3e1b 2020-11-20T11:17:43.163 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:43.163 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:43.163 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 4.9164e-05 s, 753 kB/s 2020-11-20T11:17:43.164 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:43.165 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:17:43.218 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:17:43.228 INFO:teuthology.orchestra.run.smithi166.stdout:634396c9-f3cd-4f09-8820-277d72bb90b1 2020-11-20T11:17:43.228 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:43.228 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:43.229 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 4.8812e-05 s, 758 kB/s 2020-11-20T11:17:43.230 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:43.230 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:17:43.282 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:17:43.292 INFO:teuthology.orchestra.run.smithi166.stdout:6cd744f2-abad-41dd-861f-9c3013306694 2020-11-20T11:17:43.292 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:43.293 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:43.293 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 3.6383e-05 s, 1.0 MB/s 2020-11-20T11:17:43.294 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-20T11:17:43.294 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:17:43.347 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:17:43.357 INFO:teuthology.orchestra.run.smithi166.stdout:01bcb4f2-04a5-4e09-9a98-c108f0cea3fa 2020-11-20T11:17:43.357 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-20T11:17:43.358 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-20T11:17:43.358 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 3.0129e-05 s, 1.2 MB/s 2020-11-20T11:17:43.359 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:43.359 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:17:43.373 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:17:43.383 INFO:teuthology.orchestra.run.smithi204.stdout:9cf21648-85a5-4d42-9c73-00bebbb2b440 2020-11-20T11:17:43.383 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:43.384 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:43.384 INFO:teuthology.orchestra.run.smithi204.stderr:37 bytes copied, 4.9101e-05 s, 754 kB/s 2020-11-20T11:17:43.385 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:43.386 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:17:43.438 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:17:43.448 INFO:teuthology.orchestra.run.smithi204.stdout:c52308a3-3724-47de-bb3b-6a773ac734d8 2020-11-20T11:17:43.448 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:43.449 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:43.449 INFO:teuthology.orchestra.run.smithi204.stderr:37 bytes copied, 4.4051e-05 s, 840 kB/s 2020-11-20T11:17:43.450 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:43.451 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:17:43.503 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:17:43.513 INFO:teuthology.orchestra.run.smithi204.stdout:19fa2d8f-a158-46f9-a390-7ffef109f626 2020-11-20T11:17:43.513 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:43.514 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:43.514 INFO:teuthology.orchestra.run.smithi204.stderr:37 bytes copied, 3.3949e-05 s, 1.1 MB/s 2020-11-20T11:17:43.515 INFO:teuthology.orchestra.run.smithi204:> set -ex 2020-11-20T11:17:43.515 INFO:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:17:43.569 INFO:teuthology.orchestra.run.smithi204.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:17:43.579 INFO:teuthology.orchestra.run.smithi204.stdout:a14fc070-26a3-45cd-9e46-c3dee9296758 2020-11-20T11:17:43.579 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2020-11-20T11:17:43.579 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2020-11-20T11:17:43.580 INFO:teuthology.orchestra.run.smithi204.stderr:37 bytes copied, 4.7227e-05 s, 783 kB/s 2020-11-20T11:17:43.580 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 54aafbc8-d5e6-489d-a1da-e00066837aa9 0 2020-11-20T11:17:43.729 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.727+0000 7f0389cea700 1 Processor -- start 2020-11-20T11:17:43.730 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.727+0000 7f0389cea700 1 -- start start 2020-11-20T11:17:43.732 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0389cea700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03840616f0 0x7f0384061ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.732 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0389cea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f03840bd500 0x7f03840bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.733 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0389cea700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03840c11d0 con 0x7f03840bdea0 2020-11-20T11:17:43.733 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0389cea700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03840c1470 con 0x7f03840bd500 2020-11-20T11:17:43.733 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0389cea700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03840c1710 con 0x7f03840616f0 2020-11-20T11:17:43.733 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03840616f0 0x7f0384061ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.734 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03840616f0 0x7f0384061ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:46984/0 (socket says 172.21.15.204:46984) 2020-11-20T11:17:43.734 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0383fff700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f03840bdea0 0x7f03841515f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51422/0 (socket says 172.21.15.204:51422) 2020-11-20T11:17:43.734 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 -- 172.21.15.204:0/1720226274 learned_addr learned my addr 172.21.15.204:0/1720226274 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:43.734 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f0382ffd700 1 --2- 172.21.15.204:0/1720226274 >> v2:172.21.15.112:3300/0 conn(0x7f03840bd500 0x7f03840bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.734 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 -- 172.21.15.204:0/1720226274 >> v2:172.21.15.112:3300/0 conn(0x7f03840bd500 msgr2=0x7f03840bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:43.735 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 --2- 172.21.15.204:0/1720226274 >> v2:172.21.15.112:3300/0 conn(0x7f03840bd500 0x7f03840bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.735 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 -- 172.21.15.204:0/1720226274 >> v1:172.21.15.204:6789/0 conn(0x7f03840bdea0 legacy=0x7f03841515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.735 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03827fc700 1 -- 172.21.15.204:0/1720226274 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009974905 0 0) 0x7f03840c11d0 con 0x7f03840bdea0 2020-11-20T11:17:43.735 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 -- 172.21.15.204:0/1720226274 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840c19b0 con 0x7f03840616f0 2020-11-20T11:17:43.735 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.728+0000 7f03837fe700 1 --2- 172.21.15.204:0/1720226274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384061ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f03840c57f0 tx=0x7f0378006ef0).ready entity=mon.2 client_cookie=40b4a6a9a5823277 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:43.736 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f03827fc700 1 -- 172.21.15.204:0/1720226274 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800b860 con 0x7f03840616f0 2020-11-20T11:17:43.736 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f03827fc700 1 -- 172.21.15.204:0/1720226274 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378000e90 con 0x7f03840616f0 2020-11-20T11:17:43.736 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f03827fc700 1 -- 172.21.15.204:0/1720226274 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800bbd0 con 0x7f03840616f0 2020-11-20T11:17:43.736 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 -- 172.21.15.204:0/1720226274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 msgr2=0x7f0384061ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.737 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 --2- 172.21.15.204:0/1720226274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384061ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f03840c57f0 tx=0x7f0378006ef0).stop 2020-11-20T11:17:43.737 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 -- 172.21.15.204:0/1720226274 shutdown_connections 2020-11-20T11:17:43.737 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 --2- 172.21.15.204:0/1720226274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384061ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.737 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 --2- 172.21.15.204:0/1720226274 >> v2:172.21.15.112:3300/0 conn(0x7f03840bd500 0x7f03840bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.737 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 -- 172.21.15.204:0/1720226274 >> 172.21.15.204:0/1720226274 conn(0x7f03840bac60 msgr2=0x7f03840bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:43.738 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 -- 172.21.15.204:0/1720226274 shutdown_connections 2020-11-20T11:17:43.738 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.729+0000 7f0389cea700 1 -- 172.21.15.204:0/1720226274 wait complete. 2020-11-20T11:17:43.740 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.730+0000 7f0389cea700 1 Processor -- start 2020-11-20T11:17:43.740 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 -- start start 2020-11-20T11:17:43.741 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.741 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03840bd500 0x7f0384162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.741 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03840bdea0 0x7f03840c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.741 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384143c40 con 0x7f03840bdea0 2020-11-20T11:17:43.742 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038414e8a0 con 0x7f03840bd500 2020-11-20T11:17:43.742 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0389cea700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038415e7d0 con 0x7f03840616f0 2020-11-20T11:17:43.742 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f03837fe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.742 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f03837fe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:46990/0 (socket says 172.21.15.204:46990) 2020-11-20T11:17:43.742 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f03837fe700 1 -- 172.21.15.204:0/1031864988 learned_addr learned my addr 172.21.15.204:0/1031864988 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:43.743 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.731+0000 7f0383fff700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03840bdea0 0x7f03840c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.743 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f0382ffd700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03840bd500 0x7f0384162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.743 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 -- 172.21.15.204:0/1031864988 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03840bd500 msgr2=0x7f0384162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.743 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03840bd500 0x7f0384162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.743 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 -- 172.21.15.204:0/1031864988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03840bdea0 msgr2=0x7f03840c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.744 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03840bdea0 0x7f03840c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.744 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 -- 172.21.15.204:0/1031864988 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03841468a0 con 0x7f03840616f0 2020-11-20T11:17:43.744 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03837fe700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0378006f30 tx=0x7f0378016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:43.744 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378011bb0 con 0x7f03840616f0 2020-11-20T11:17:43.744 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378011d10 con 0x7f03840616f0 2020-11-20T11:17:43.745 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038414eb00 con 0x7f03840616f0 2020-11-20T11:17:43.745 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037801c670 con 0x7f03840616f0 2020-11-20T11:17:43.745 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038414f040 con 0x7f03840616f0 2020-11-20T11:17:43.745 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f037802c070 con 0x7f03840616f0 2020-11-20T11:17:43.746 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.732+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f03780257c0 con 0x7f03840616f0 2020-11-20T11:17:43.746 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.733+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03840c1b90 con 0x7f03840616f0 2020-11-20T11:17:43.746 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.735+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f0378044880 con 0x7f03840616f0 2020-11-20T11:17:43.816 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.813+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54aafbc8-d5e6-489d-a1da-e00066837aa9", "id": 0} v 0) v1 -- 0x7f0384162c30 con 0x7f03840616f0 2020-11-20T11:17:43.823 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.820+0000 7f03637fe700 1 -- 172.21.15.204:0/1031864988 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54aafbc8-d5e6-489d-a1da-e00066837aa9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0378033070 con 0x7f03840616f0 2020-11-20T11:17:43.824 INFO:teuthology.orchestra.run.smithi204.stdout:0 2020-11-20T11:17:43.825 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 msgr2=0x7f0384146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.825 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0378006f30 tx=0x7f0378016000).stop 2020-11-20T11:17:43.825 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 shutdown_connections 2020-11-20T11:17:43.825 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03840bdea0 0x7f03840c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.826 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03840616f0 0x7f0384146300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.826 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 --2- 172.21.15.204:0/1031864988 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03840bd500 0x7f0384162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.826 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 >> 172.21.15.204:0/1031864988 conn(0x7f03840bac60 msgr2=0x7f0384149750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:43.826 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 shutdown_connections 2020-11-20T11:17:43.826 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.821+0000 7f0389cea700 1 -- 172.21.15.204:0/1031864988 wait complete. 2020-11-20T11:17:43.835 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 708a3e7b-2c3b-45db-8333-c571a5fe3e1b 1 2020-11-20T11:17:43.968 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.966+0000 7f03e3a71700 1 Processor -- start 2020-11-20T11:17:43.969 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.966+0000 7f03e3a71700 1 -- start start 2020-11-20T11:17:43.971 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e3a71700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f03dc065d30 0x7f03dc066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.971 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e3a71700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03dc1512e0 0x7f03dc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.971 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e3a71700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0c5230 con 0x7f03dc0bfa50 2020-11-20T11:17:43.972 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e3a71700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc1549c0 con 0x7f03dc065d30 2020-11-20T11:17:43.972 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e3a71700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc154c60 con 0x7f03dc1512e0 2020-11-20T11:17:43.972 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e200e700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03dc1512e0 0x7f03dc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.972 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e100c700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f03dc0bfa50 0x7f03dc0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51430/0 (socket says 172.21.15.204:51430) 2020-11-20T11:17:43.973 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e100c700 1 -- 172.21.15.204:0/1918029061 learned_addr learned my addr 172.21.15.204:0/1918029061 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:43.973 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e180d700 1 --2- 172.21.15.204:0/1918029061 >> v2:172.21.15.166:3300/0 conn(0x7f03dc065d30 0x7f03dc066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.973 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e080b700 1 -- 172.21.15.204:0/1918029061 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210961497 0 0) 0x7f03dc0c5230 con 0x7f03dc0bfa50 2020-11-20T11:17:43.973 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e080b700 1 -- 172.21.15.204:0/1918029061 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003280 con 0x7f03dc0bfa50 2020-11-20T11:17:43.973 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e200e700 1 -- 172.21.15.204:0/1918029061 >> v2:172.21.15.166:3300/0 conn(0x7f03dc065d30 msgr2=0x7f03dc066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:43.974 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e200e700 1 --2- 172.21.15.204:0/1918029061 >> v2:172.21.15.166:3300/0 conn(0x7f03dc065d30 0x7f03dc066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.974 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e200e700 1 -- 172.21.15.204:0/1918029061 >> v1:172.21.15.204:6789/0 conn(0x7f03dc0bfa50 legacy=0x7f03dc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.974 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.967+0000 7f03e200e700 1 -- 172.21.15.204:0/1918029061 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc154f00 con 0x7f03dc1512e0 2020-11-20T11:17:43.974 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e200e700 1 --2- 172.21.15.204:0/1918029061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc1512e0 0x7f03dc151710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f03dc0651b0 tx=0x7f03d4009220).ready entity=mon.2 client_cookie=aeaec1d0ebb4b9c9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:43.974 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e080b700 1 -- 172.21.15.204:0/1918029061 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400b950 con 0x7f03dc1512e0 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e080b700 1 -- 172.21.15.204:0/1918029061 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400bab0 con 0x7f03dc1512e0 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e080b700 1 -- 172.21.15.204:0/1918029061 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400be30 con 0x7f03dc1512e0 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 -- 172.21.15.204:0/1918029061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc1512e0 msgr2=0x7f03dc151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 --2- 172.21.15.204:0/1918029061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc1512e0 0x7f03dc151710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f03dc0651b0 tx=0x7f03d4009220).stop 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 -- 172.21.15.204:0/1918029061 shutdown_connections 2020-11-20T11:17:43.975 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 --2- 172.21.15.204:0/1918029061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc1512e0 0x7f03dc151710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.976 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 --2- 172.21.15.204:0/1918029061 >> v2:172.21.15.166:3300/0 conn(0x7f03dc065d30 0x7f03dc066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.976 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.968+0000 7f03e3a71700 1 -- 172.21.15.204:0/1918029061 >> 172.21.15.204:0/1918029061 conn(0x7f03dc05bac0 msgr2=0x7f03dc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:43.976 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.969+0000 7f03e3a71700 1 -- 172.21.15.204:0/1918029061 shutdown_connections 2020-11-20T11:17:43.976 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.969+0000 7f03e3a71700 1 -- 172.21.15.204:0/1918029061 wait complete. 2020-11-20T11:17:43.979 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 Processor -- start 2020-11-20T11:17:43.979 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 -- start start 2020-11-20T11:17:43.979 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03dc065d30 0x7f03dc160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.979 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.979 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03dc1512e0 0x7f03dc161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:43.980 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0b3cd0 con 0x7f03dc065d30 2020-11-20T11:17:43.980 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc164830 con 0x7f03dc1512e0 2020-11-20T11:17:43.980 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e3a71700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0b4250 con 0x7f03dc0bfa50 2020-11-20T11:17:43.980 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.970+0000 7f03e100c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.980 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47004/0 (socket says 172.21.15.204:47004) 2020-11-20T11:17:43.981 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 -- 172.21.15.204:0/177618603 learned_addr learned my addr 172.21.15.204:0/177618603 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:43.981 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e200e700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03dc1512e0 0x7f03dc161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.981 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e180d700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03dc065d30 0x7f03dc160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:43.981 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 -- 172.21.15.204:0/177618603 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03dc1512e0 msgr2=0x7f03dc161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.981 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03dc1512e0 0x7f03dc161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.982 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 -- 172.21.15.204:0/177618603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03dc065d30 msgr2=0x7f03dc160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:43.982 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03dc065d30 0x7f03dc160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:43.982 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 -- 172.21.15.204:0/177618603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0b44f0 con 0x7f03dc0bfa50 2020-11-20T11:17:43.982 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e100c700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f03d800c710 tx=0x7f03d8007b00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:43.982 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80072e0 con 0x7f03dc0bfa50 2020-11-20T11:17:43.983 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8007440 con 0x7f03dc0bfa50 2020-11-20T11:17:43.983 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc1604b0 con 0x7f03dc0bfa50 2020-11-20T11:17:43.983 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8005860 con 0x7f03dc0bfa50 2020-11-20T11:17:43.983 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f03d8010070 con 0x7f03dc0bfa50 2020-11-20T11:17:43.983 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc1609f0 con 0x7f03dc0bfa50 2020-11-20T11:17:43.984 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.971+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f03d8013810 con 0x7f03dc0bfa50 2020-11-20T11:17:43.984 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.972+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0b3fa0 con 0x7f03dc0bfa50 2020-11-20T11:17:43.984 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:43.974+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f03d8018020 con 0x7f03dc0bfa50 2020-11-20T11:17:44.054 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.052+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "708a3e7b-2c3b-45db-8333-c571a5fe3e1b", "id": 1} v 0) v1 -- 0x7f03dc0666e0 con 0x7f03dc0bfa50 2020-11-20T11:17:44.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.059+0000 7f03cdffb700 1 -- 172.21.15.204:0/177618603 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "708a3e7b-2c3b-45db-8333-c571a5fe3e1b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03d8013a90 con 0x7f03dc0bfa50 2020-11-20T11:17:44.062 INFO:teuthology.orchestra.run.smithi204.stdout:1 2020-11-20T11:17:44.063 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 msgr2=0x7f03dc164340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.063 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f03d800c710 tx=0x7f03d8007b00).stop 2020-11-20T11:17:44.064 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 shutdown_connections 2020-11-20T11:17:44.064 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f03dc1512e0 0x7f03dc161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.064 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03dc065d30 0x7f03dc160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 --2- 172.21.15.204:0/177618603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03dc0bfa50 0x7f03dc164340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 >> 172.21.15.204:0/177618603 conn(0x7f03dc05bac0 msgr2=0x7f03dc1539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 shutdown_connections 2020-11-20T11:17:44.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.060+0000 7f03e3a71700 1 -- 172.21.15.204:0/177618603 wait complete. 2020-11-20T11:17:44.074 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 9cf21648-85a5-4d42-9c73-00bebbb2b440 2 2020-11-20T11:17:44.184 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.182+0000 7f30f4a73700 1 Processor -- start 2020-11-20T11:17:44.185 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.182+0000 7f30f4a73700 1 -- start start 2020-11-20T11:17:44.186 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30f4a73700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30f00c5df0 0x7f30f0155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.186 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30f4a73700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f01516b0 con 0x7f30f0061930 2020-11-20T11:17:44.187 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30f4a73700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f01518e0 con 0x7f30f00c5a10 2020-11-20T11:17:44.187 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30f4a73700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f0151b80 con 0x7f30f00c5df0 2020-11-20T11:17:44.187 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30eed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30f00c5df0 0x7f30f0155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.187 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30edd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f30f0061930 0x7f30f0064720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.204:58020/0 (socket says 172.21.15.204:58020) 2020-11-20T11:17:44.187 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30edd9b700 1 -- 172.21.15.204:0/2667400776 learned_addr learned my addr 172.21.15.204:0/2667400776 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:44.188 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292572270 0 0) 0x7f30f01518e0 con 0x7f30f00c5a10 2020-11-20T11:17:44.188 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d4003280 con 0x7f30f00c5a10 2020-11-20T11:17:44.188 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30eed9d700 1 -- 172.21.15.204:0/2667400776 >> v1:172.21.15.166:6789/0 conn(0x7f30f00c5a10 legacy=0x7f30f0061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.188 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30eed9d700 1 -- 172.21.15.204:0/2667400776 >> v1:172.21.15.112:6789/0 conn(0x7f30f0061930 legacy=0x7f30f0064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.188 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878365390 0 0) 0x7f30f01516b0 con 0x7f30f0061930 2020-11-20T11:17:44.189 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30eed9d700 1 -- 172.21.15.204:0/2667400776 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0151e20 con 0x7f30f00c5df0 2020-11-20T11:17:44.189 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30eed9d700 1 --2- 172.21.15.204:0/2667400776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f00c5df0 0x7f30f0155700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f30e8009ce0 tx=0x7f30e8009220).ready entity=mon.0 client_cookie=7a9e0aaad1265c73 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.189 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.183+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800ba40 con 0x7f30f00c5df0 2020-11-20T11:17:44.189 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800bba0 con 0x7f30f00c5df0 2020-11-20T11:17:44.189 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30ed59a700 1 -- 172.21.15.204:0/2667400776 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8011400 con 0x7f30f00c5df0 2020-11-20T11:17:44.192 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 -- 172.21.15.204:0/2667400776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f00c5df0 msgr2=0x7f30f0155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.192 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2667400776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f00c5df0 0x7f30f0155700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f30e8009ce0 tx=0x7f30e8009220).stop 2020-11-20T11:17:44.192 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 -- 172.21.15.204:0/2667400776 shutdown_connections 2020-11-20T11:17:44.193 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2667400776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f00c5df0 0x7f30f0155700 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.193 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 -- 172.21.15.204:0/2667400776 >> 172.21.15.204:0/2667400776 conn(0x7f30f00bbc50 msgr2=0x7f30f00bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.193 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 -- 172.21.15.204:0/2667400776 shutdown_connections 2020-11-20T11:17:44.193 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.184+0000 7f30f4a73700 1 -- 172.21.15.204:0/2667400776 wait complete. 2020-11-20T11:17:44.194 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.185+0000 7f30f4a73700 1 Processor -- start 2020-11-20T11:17:44.194 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.185+0000 7f30f4a73700 1 -- start start 2020-11-20T11:17:44.194 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 0x7f30f0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.194 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f30f00c5a10 0x7f30f0149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.194 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00bfc20 con 0x7f30f0061930 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0155000 con 0x7f30f00c5a10 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30f4a73700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00bf480 con 0x7f30f00c5df0 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47018/0 (socket says 172.21.15.204:47018) 2020-11-20T11:17:44.195 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 -- 172.21.15.204:0/2661010814 learned_addr learned my addr 172.21.15.204:0/2661010814 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:44.196 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30ee59c700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 0x7f30f0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.196 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30edd9b700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f30f00c5a10 0x7f30f0149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.196 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 -- 172.21.15.204:0/2661010814 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f30f00c5a10 msgr2=0x7f30f0149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.196 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f30f00c5a10 0x7f30f0149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 -- 172.21.15.204:0/2661010814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 msgr2=0x7f30f0154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 0x7f30f0154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30eed9d700 1 -- 172.21.15.204:0/2661010814 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f01146f0 con 0x7f30f00c5df0 2020-11-20T11:17:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.186+0000 7f30ee59c700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 0x7f30f0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30eed9d700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f30f0062c50 tx=0x7f30e8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.198 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8010a50 con 0x7f30f00c5df0 2020-11-20T11:17:44.198 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8010bb0 con 0x7f30f00c5df0 2020-11-20T11:17:44.198 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e801d480 con 0x7f30f00c5df0 2020-11-20T11:17:44.198 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00bf6e0 con 0x7f30f00c5df0 2020-11-20T11:17:44.198 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.187+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00bcd40 con 0x7f30f00c5df0 2020-11-20T11:17:44.199 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.188+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f014a5b0 con 0x7f30f00c5df0 2020-11-20T11:17:44.199 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.188+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f30e8017070 con 0x7f30f00c5df0 2020-11-20T11:17:44.199 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.188+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f30e801c830 con 0x7f30f00c5df0 2020-11-20T11:17:44.199 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.190+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f30e8015020 con 0x7f30f00c5df0 2020-11-20T11:17:44.270 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.267+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9cf21648-85a5-4d42-9c73-00bebbb2b440", "id": 2} v 0) v1 -- 0x7f30f00666e0 con 0x7f30f00c5df0 2020-11-20T11:17:44.277 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.275+0000 7f30de7fc700 1 -- 172.21.15.204:0/2661010814 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cf21648-85a5-4d42-9c73-00bebbb2b440", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30e801dcc0 con 0x7f30f00c5df0 2020-11-20T11:17:44.278 INFO:teuthology.orchestra.run.smithi204.stdout:2 2020-11-20T11:17:44.279 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 msgr2=0x7f30f014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.279 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f30f0062c50 tx=0x7f30e8016000).stop 2020-11-20T11:17:44.279 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 shutdown_connections 2020-11-20T11:17:44.279 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f00c5df0 0x7f30f014a0c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0061930 0x7f30f0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 --2- 172.21.15.204:0/2661010814 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f30f00c5a10 0x7f30f0149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 >> 172.21.15.204:0/2661010814 conn(0x7f30f00bbc50 msgr2=0x7f30f0150f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 shutdown_connections 2020-11-20T11:17:44.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.276+0000 7f30f4a73700 1 -- 172.21.15.204:0/2661010814 wait complete. 2020-11-20T11:17:44.289 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 91f91662-644d-4bab-b8a0-2149ada31978 3 2020-11-20T11:17:44.400 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.397+0000 7f7141bfe700 1 Processor -- start 2020-11-20T11:17:44.400 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.397+0000 7f7141bfe700 1 -- start start 2020-11-20T11:17:44.402 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f7141bfe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f713c066b60 0x7f713c066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.402 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f7141bfe700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 0x7f713c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.403 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f7141bfe700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c151490 con 0x7f713c0bb8e0 2020-11-20T11:17:44.403 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f7141bfe700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c064510 con 0x7f713c066b60 2020-11-20T11:17:44.403 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f7141bfe700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c063a90 con 0x7f713c1518f0 2020-11-20T11:17:44.403 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f713c066b60 0x7f713c066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.404 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f713c0bb8e0 0x7f713c0c16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.204:58034/0 (socket says 172.21.15.204:58034) 2020-11-20T11:17:44.404 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713bfff700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 0x7f713c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.404 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713affd700 1 -- 172.21.15.204:0/393988764 learned_addr learned my addr 172.21.15.204:0/393988764 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:44.404 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713b7fe700 1 -- 172.21.15.204:0/393988764 >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 msgr2=0x7f713c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:44.404 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713b7fe700 1 --2- 172.21.15.204:0/393988764 >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 0x7f713c151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.405 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713b7fe700 1 -- 172.21.15.204:0/393988764 >> v1:172.21.15.112:6789/0 conn(0x7f713c0bb8e0 legacy=0x7f713c0c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.405 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713b7fe700 1 -- 172.21.15.204:0/393988764 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c063d30 con 0x7f713c066b60 2020-11-20T11:17:44.405 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713a7fc700 1 -- 172.21.15.204:0/393988764 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661821912 0 0) 0x7f713c151490 con 0x7f713c0bb8e0 2020-11-20T11:17:44.405 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.398+0000 7f713bfff700 1 --2- 172.21.15.204:0/393988764 >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 0x7f713c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:44.405 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f713b7fe700 1 --2- 172.21.15.204:0/393988764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c066f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f713c0c0c60 tx=0x7f712c006e30).ready entity=mon.0 client_cookie=db4e84061244ad2d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.406 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f713a7fc700 1 -- 172.21.15.204:0/393988764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0097b0 con 0x7f713c066b60 2020-11-20T11:17:44.406 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f713a7fc700 1 -- 172.21.15.204:0/393988764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c000e90 con 0x7f713c066b60 2020-11-20T11:17:44.406 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f713a7fc700 1 -- 172.21.15.204:0/393988764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c009b20 con 0x7f713c066b60 2020-11-20T11:17:44.406 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 -- 172.21.15.204:0/393988764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 msgr2=0x7f713c066f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.406 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 --2- 172.21.15.204:0/393988764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c066f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f713c0c0c60 tx=0x7f712c006e30).stop 2020-11-20T11:17:44.407 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 -- 172.21.15.204:0/393988764 shutdown_connections 2020-11-20T11:17:44.407 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 --2- 172.21.15.204:0/393988764 >> v2:172.21.15.166:3300/0 conn(0x7f713c1518f0 0x7f713c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.409 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 --2- 172.21.15.204:0/393988764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c066f40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.409 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 -- 172.21.15.204:0/393988764 >> 172.21.15.204:0/393988764 conn(0x7f713c0bac60 msgr2=0x7f713c0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.409 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 -- 172.21.15.204:0/393988764 shutdown_connections 2020-11-20T11:17:44.409 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.399+0000 7f7141bfe700 1 -- 172.21.15.204:0/393988764 wait complete. 2020-11-20T11:17:44.412 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.400+0000 7f7141bfe700 1 Processor -- start 2020-11-20T11:17:44.412 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 -- start start 2020-11-20T11:17:44.412 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.412 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f713c0bb8e0 0x7f713c0c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.412 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.413 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c4770 con 0x7f713c066b60 2020-11-20T11:17:44.413 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c3580 con 0x7f713c0bb8e0 2020-11-20T11:17:44.413 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f7141bfe700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c4ab0 con 0x7f713c1518f0 2020-11-20T11:17:44.413 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f713bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.413 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f713b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.414 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f713bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47030/0 (socket says 172.21.15.204:47030) 2020-11-20T11:17:44.414 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f713bfff700 1 -- 172.21.15.204:0/826713353 learned_addr learned my addr 172.21.15.204:0/826713353 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:44.414 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.401+0000 7f713affd700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f713c0bb8e0 0x7f713c0c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.414 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 -- 172.21.15.204:0/826713353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 msgr2=0x7f713c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.414 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.415 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 -- 172.21.15.204:0/826713353 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f713c0bb8e0 msgr2=0x7f713c0c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.415 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f713c0bb8e0 0x7f713c0c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.415 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 -- 172.21.15.204:0/826713353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0c4d50 con 0x7f713c066b60 2020-11-20T11:17:44.415 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713bfff700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:44.415 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f713b7fe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c158420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f712c012000 tx=0x7f712c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.416 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c011b40 con 0x7f713c066b60 2020-11-20T11:17:44.416 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c011ca0 con 0x7f713c066b60 2020-11-20T11:17:44.416 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0c4ff0 con 0x7f713c066b60 2020-11-20T11:17:44.416 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c01e690 con 0x7f713c066b60 2020-11-20T11:17:44.417 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c161e80 con 0x7f713c066b60 2020-11-20T11:17:44.417 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f712c025030 con 0x7f713c066b60 2020-11-20T11:17:44.417 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.402+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f712c011e10 con 0x7f713c066b60 2020-11-20T11:17:44.417 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.403+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c1568b0 con 0x7f713c066b60 2020-11-20T11:17:44.417 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.405+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f712c02d060 con 0x7f713c066b60 2020-11-20T11:17:44.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.497+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91f91662-644d-4bab-b8a0-2149ada31978", "id": 3} v 0) v1 -- 0x7f713c0666e0 con 0x7f713c066b60 2020-11-20T11:17:44.502 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.500+0000 7f71337fe700 1 -- 172.21.15.204:0/826713353 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91f91662-644d-4bab-b8a0-2149ada31978", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f712c023070 con 0x7f713c066b60 2020-11-20T11:17:44.503 INFO:teuthology.orchestra.run.smithi204.stdout:3 2020-11-20T11:17:44.504 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 msgr2=0x7f713c158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.504 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c158420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f712c012000 tx=0x7f712c015000).stop 2020-11-20T11:17:44.505 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 shutdown_connections 2020-11-20T11:17:44.505 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f713c1518f0 0x7f713c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.505 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f713c066b60 0x7f713c158420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.505 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 --2- 172.21.15.204:0/826713353 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f713c0bb8e0 0x7f713c0c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.505 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 >> 172.21.15.204:0/826713353 conn(0x7f713c0bac60 msgr2=0x7f713c14f630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.506 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 shutdown_connections 2020-11-20T11:17:44.506 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.501+0000 7f7141bfe700 1 -- 172.21.15.204:0/826713353 wait complete. 2020-11-20T11:17:44.515 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 634396c9-f3cd-4f09-8820-277d72bb90b1 4 2020-11-20T11:17:44.628 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.625+0000 7fa6324b6700 1 Processor -- start 2020-11-20T11:17:44.628 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.625+0000 7fa6324b6700 1 -- start start 2020-11-20T11:17:44.630 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa6324b6700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa62c061ad0 0x7fa62c0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.630 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa6324b6700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0c11d0 con 0x7fa62c154c00 2020-11-20T11:17:44.631 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa6324b6700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0c1470 con 0x7fa62c0616f0 2020-11-20T11:17:44.631 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa6324b6700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c0c1710 con 0x7fa62c061ad0 2020-11-20T11:17:44.631 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa62b7fe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa62c061ad0 0x7fa62c0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.631 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa62bfff700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa62c0616f0 0x7fa62c0bd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51466/0 (socket says 172.21.15.204:51466) 2020-11-20T11:17:44.631 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.626+0000 7fa62bfff700 1 -- 172.21.15.204:0/1592815204 learned_addr learned my addr 172.21.15.204:0/1592815204 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:44.632 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62b7fe700 1 -- 172.21.15.204:0/1592815204 >> v1:172.21.15.204:6789/0 conn(0x7fa62c0616f0 legacy=0x7fa62c0bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.632 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62b7fe700 1 -- 172.21.15.204:0/1592815204 >> v1:172.21.15.166:6789/0 conn(0x7fa62c154c00 legacy=0x7fa62c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.632 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62b7fe700 1 -- 172.21.15.204:0/1592815204 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0c19b0 con 0x7fa62c061ad0 2020-11-20T11:17:44.632 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62b7fe700 1 --2- 172.21.15.204:0/1592815204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c061ad0 0x7fa62c0bdc10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa61c00ba00 tx=0x7fa61c006e30).ready entity=mon.2 client_cookie=584a5f489443059e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.632 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62affd700 1 -- 172.21.15.204:0/1592815204 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0097a0 con 0x7fa62c061ad0 2020-11-20T11:17:44.633 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62affd700 1 -- 172.21.15.204:0/1592815204 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c000e90 con 0x7fa62c061ad0 2020-11-20T11:17:44.633 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.627+0000 7fa62affd700 1 -- 172.21.15.204:0/1592815204 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c009b10 con 0x7fa62c061ad0 2020-11-20T11:17:44.633 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 -- 172.21.15.204:0/1592815204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c061ad0 msgr2=0x7fa62c0bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.633 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 --2- 172.21.15.204:0/1592815204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c061ad0 0x7fa62c0bdc10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa61c00ba00 tx=0x7fa61c006e30).stop 2020-11-20T11:17:44.633 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 -- 172.21.15.204:0/1592815204 shutdown_connections 2020-11-20T11:17:44.634 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 --2- 172.21.15.204:0/1592815204 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c061ad0 0x7fa62c0bdc10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.634 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 -- 172.21.15.204:0/1592815204 >> 172.21.15.204:0/1592815204 conn(0x7fa62c0bac60 msgr2=0x7fa62c0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.634 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 -- 172.21.15.204:0/1592815204 shutdown_connections 2020-11-20T11:17:44.634 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.628+0000 7fa6324b6700 1 -- 172.21.15.204:0/1592815204 wait complete. 2020-11-20T11:17:44.637 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.629+0000 7fa6324b6700 1 Processor -- start 2020-11-20T11:17:44.637 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.629+0000 7fa6324b6700 1 -- start start 2020-11-20T11:17:44.637 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa62c0616f0 0x7fa62c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.637 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa62c061ad0 0x7fa62c140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.637 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.638 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c161ef0 con 0x7fa62c0616f0 2020-11-20T11:17:44.638 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c162190 con 0x7fa62c061ad0 2020-11-20T11:17:44.638 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c162430 con 0x7fa62c154c00 2020-11-20T11:17:44.638 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.638 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47042/0 (socket says 172.21.15.204:47042) 2020-11-20T11:17:44.639 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 -- 172.21.15.204:0/174993608 learned_addr learned my addr 172.21.15.204:0/174993608 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:44.639 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa62b7fe700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa62c061ad0 0x7fa62c140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.639 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa62bfff700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa62c0616f0 0x7fa62c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.639 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 -- 172.21.15.204:0/174993608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa62c061ad0 msgr2=0x7fa62c140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.639 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa62c061ad0 0x7fa62c140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.640 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 -- 172.21.15.204:0/174993608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa62c0616f0 msgr2=0x7fa62c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.640 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa62c0616f0 0x7fa62c15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.640 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 -- 172.21.15.204:0/174993608 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c1626d0 con 0x7fa62c154c00 2020-11-20T11:17:44.640 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa630a53700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa62400ca90 tx=0x7fa6240013a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.641 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400a550 con 0x7fa62c154c00 2020-11-20T11:17:44.641 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400a6b0 con 0x7fa62c154c00 2020-11-20T11:17:44.641 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400aa30 con 0x7fa62c154c00 2020-11-20T11:17:44.641 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c162970 con 0x7fa62c154c00 2020-11-20T11:17:44.641 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.630+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c161bb0 con 0x7fa62c154c00 2020-11-20T11:17:44.642 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.631+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fa624018020 con 0x7fa62c154c00 2020-11-20T11:17:44.642 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.631+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fa62400ade0 con 0x7fa62c154c00 2020-11-20T11:17:44.642 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.631+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0666e0 con 0x7fa62c154c00 2020-11-20T11:17:44.642 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.633+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fa624016020 con 0x7fa62c154c00 2020-11-20T11:17:44.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.710+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "634396c9-f3cd-4f09-8820-277d72bb90b1", "id": 4} v 0) v1 -- 0x7fa62c05d370 con 0x7fa62c154c00 2020-11-20T11:17:44.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.714+0000 7fa623fff700 1 -- 172.21.15.204:0/174993608 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "634396c9-f3cd-4f09-8820-277d72bb90b1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa62402a0b0 con 0x7fa62c154c00 2020-11-20T11:17:44.716 INFO:teuthology.orchestra.run.smithi204.stdout:4 2020-11-20T11:17:44.717 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.714+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 msgr2=0x7fa62c0c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.718 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.714+0000 7fa6324b6700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa62400ca90 tx=0x7fa6240013a0).stop 2020-11-20T11:17:44.718 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 shutdown_connections 2020-11-20T11:17:44.718 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa62c154c00 0x7fa62c0c34e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.718 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa62c0616f0 0x7fa62c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.718 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 --2- 172.21.15.204:0/174993608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa62c061ad0 0x7fa62c140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.719 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 >> 172.21.15.204:0/174993608 conn(0x7fa62c0bac60 msgr2=0x7fa62c068190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.719 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 shutdown_connections 2020-11-20T11:17:44.719 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.715+0000 7fa6324b6700 1 -- 172.21.15.204:0/174993608 wait complete. 2020-11-20T11:17:44.728 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c52308a3-3724-47de-bb3b-6a773ac734d8 5 2020-11-20T11:17:44.841 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.838+0000 7fd0624e3700 1 Processor -- start 2020-11-20T11:17:44.841 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.838+0000 7fd0624e3700 1 -- start start 2020-11-20T11:17:44.843 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd0624e3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd05c14c810 0x7fd05c060bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.843 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd0624e3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c1526d0 con 0x7fd05c14c430 2020-11-20T11:17:44.844 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd0624e3700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c152970 con 0x7fd05c0670b0 2020-11-20T11:17:44.844 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd0624e3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c152c10 con 0x7fd05c14c810 2020-11-20T11:17:44.844 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd060a80700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fd05c0670b0 0x7fd05c0610a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51482/0 (socket says 172.21.15.204:51482) 2020-11-20T11:17:44.844 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd060a80700 1 -- 172.21.15.204:0/1125773677 learned_addr learned my addr 172.21.15.204:0/1125773677 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:44.844 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05b7fe700 1 --2- 172.21.15.204:0/1125773677 >> v2:172.21.15.112:3300/0 conn(0x7fd05c14c810 0x7fd05c060bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.845 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748122704 0 0) 0x7fd05c152970 con 0x7fd05c0670b0 2020-11-20T11:17:44.845 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c003280 con 0x7fd05c0670b0 2020-11-20T11:17:44.845 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406861191 0 0) 0x7fd05c1526d0 con 0x7fd05c14c430 2020-11-20T11:17:44.845 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c152970 con 0x7fd05c14c430 2020-11-20T11:17:44.845 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05b7fe700 1 -- 172.21.15.204:0/1125773677 >> v1:172.21.15.204:6789/0 conn(0x7fd05c0670b0 legacy=0x7fd05c0610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.846 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05b7fe700 1 -- 172.21.15.204:0/1125773677 >> v1:172.21.15.166:6789/0 conn(0x7fd05c14c430 legacy=0x7fd05c0c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.846 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.839+0000 7fd05b7fe700 1 -- 172.21.15.204:0/1125773677 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c152eb0 con 0x7fd05c14c810 2020-11-20T11:17:44.846 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd05b7fe700 1 --2- 172.21.15.204:0/1125773677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c060bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd04c00ba00 tx=0x7fd04c006e30).ready entity=mon.0 client_cookie=4e535a534b5375e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.846 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0095f0 con 0x7fd05c14c810 2020-11-20T11:17:44.846 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c000e90 con 0x7fd05c14c810 2020-11-20T11:17:44.847 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd05affd700 1 -- 172.21.15.204:0/1125773677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c009960 con 0x7fd05c14c810 2020-11-20T11:17:44.847 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 -- 172.21.15.204:0/1125773677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 msgr2=0x7fd05c060bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.847 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 --2- 172.21.15.204:0/1125773677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c060bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd04c00ba00 tx=0x7fd04c006e30).stop 2020-11-20T11:17:44.847 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 -- 172.21.15.204:0/1125773677 shutdown_connections 2020-11-20T11:17:44.847 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 --2- 172.21.15.204:0/1125773677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c060bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.848 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 -- 172.21.15.204:0/1125773677 >> 172.21.15.204:0/1125773677 conn(0x7fd05c05bac0 msgr2=0x7fd05c0669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.848 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 -- 172.21.15.204:0/1125773677 shutdown_connections 2020-11-20T11:17:44.848 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.840+0000 7fd0624e3700 1 -- 172.21.15.204:0/1125773677 wait complete. 2020-11-20T11:17:44.850 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.841+0000 7fd0624e3700 1 Processor -- start 2020-11-20T11:17:44.851 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 -- start start 2020-11-20T11:17:44.851 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.851 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd05c14c430 0x7fd05c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.851 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:44.852 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c14db00 con 0x7fd05c14c810 2020-11-20T11:17:44.852 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1464d0 con 0x7fd05c14c430 2020-11-20T11:17:44.852 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd0624e3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c146770 con 0x7fd05c0670b0 2020-11-20T11:17:44.852 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.852 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47050/0 (socket says 172.21.15.204:47050) 2020-11-20T11:17:44.853 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd05bfff700 1 -- 172.21.15.204:0/2821498180 learned_addr learned my addr 172.21.15.204:0/2821498180 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:44.853 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.842+0000 7fd060a80700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.853 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05b7fe700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd05c14c430 0x7fd05c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:44.854 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 -- 172.21.15.204:0/2821498180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd05c14c430 msgr2=0x7fd05c14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.854 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd05c14c430 0x7fd05c14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.854 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 -- 172.21.15.204:0/2821498180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 msgr2=0x7fd05c150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.854 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.855 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 -- 172.21.15.204:0/2821498180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c146a10 con 0x7fd05c0670b0 2020-11-20T11:17:44.855 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd05bfff700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd04400c710 tx=0x7fd044007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:44.855 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044013410 con 0x7fd05c0670b0 2020-11-20T11:17:44.855 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044013570 con 0x7fd05c0670b0 2020-11-20T11:17:44.855 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c146cb0 con 0x7fd05c0670b0 2020-11-20T11:17:44.856 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440138f0 con 0x7fd05c0670b0 2020-11-20T11:17:44.856 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.843+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c150e30 con 0x7fd05c0670b0 2020-11-20T11:17:44.856 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.844+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd044010030 con 0x7fd05c0670b0 2020-11-20T11:17:44.856 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.844+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c146e40 con 0x7fd05c0670b0 2020-11-20T11:17:44.856 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.844+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fd04401d490 con 0x7fd05c0670b0 2020-11-20T11:17:44.857 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.846+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd04401c3e0 con 0x7fd05c0670b0 2020-11-20T11:17:44.927 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.924+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c52308a3-3724-47de-bb3b-6a773ac734d8", "id": 5} v 0) v1 -- 0x7fd05c0666e0 con 0x7fd05c0670b0 2020-11-20T11:17:44.930 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.928+0000 7fd053fff700 1 -- 172.21.15.204:0/2821498180 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c52308a3-3724-47de-bb3b-6a773ac734d8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd04401da30 con 0x7fd05c0670b0 2020-11-20T11:17:44.930 INFO:teuthology.orchestra.run.smithi204.stdout:5 2020-11-20T11:17:44.932 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 msgr2=0x7fd05c147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:44.932 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd04400c710 tx=0x7fd044007ad0).stop 2020-11-20T11:17:44.932 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 shutdown_connections 2020-11-20T11:17:44.932 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd05c14c810 0x7fd05c150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.933 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd05c0670b0 0x7fd05c147150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.933 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 --2- 172.21.15.204:0/2821498180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd05c14c430 0x7fd05c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:44.933 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 >> 172.21.15.204:0/2821498180 conn(0x7fd05c05bac0 msgr2=0x7fd05c14a960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:44.933 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 shutdown_connections 2020-11-20T11:17:44.933 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:44.929+0000 7fd0624e3700 1 -- 172.21.15.204:0/2821498180 wait complete. 2020-11-20T11:17:44.942 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c101d1b8-188b-4a96-a6c8-327b3d6e4b74 6 2020-11-20T11:17:45.054 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.051+0000 7fac6d1de700 1 Processor -- start 2020-11-20T11:17:45.054 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.051+0000 7fac6d1de700 1 -- start start 2020-11-20T11:17:45.057 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac68064b90 0x7fac68064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.057 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fac68060f10 0x7fac680bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.057 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fac680bc030 0x7fac6814a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.057 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6814d8a0 con 0x7fac68064b90 2020-11-20T11:17:45.058 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac68151110 con 0x7fac680bc030 2020-11-20T11:17:45.058 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6d1de700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac681513b0 con 0x7fac68060f10 2020-11-20T11:17:45.058 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6659c700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fac68060f10 0x7fac680bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.058 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6659c700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fac68060f10 0x7fac680bbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47056/0 (socket says 172.21.15.204:47056) 2020-11-20T11:17:45.058 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6659c700 1 -- 172.21.15.204:0/1366035559 learned_addr learned my addr 172.21.15.204:0/1366035559 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.059 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac66d9d700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.112:3300/0 conn(0x7fac68064b90 0x7fac68064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.059 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.052+0000 7fac6759e700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.166:3300/0 conn(0x7fac680bc030 0x7fac6814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.059 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 -- 172.21.15.204:0/1366035559 >> v2:172.21.15.166:3300/0 conn(0x7fac680bc030 msgr2=0x7fac6814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:45.059 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.166:3300/0 conn(0x7fac680bc030 0x7fac6814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.059 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 -- 172.21.15.204:0/1366035559 >> v2:172.21.15.112:3300/0 conn(0x7fac68064b90 msgr2=0x7fac68064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:45.060 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.112:3300/0 conn(0x7fac68064b90 0x7fac68064f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.060 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 -- 172.21.15.204:0/1366035559 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68151650 con 0x7fac68060f10 2020-11-20T11:17:45.060 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6659c700 1 --2- 172.21.15.204:0/1366035559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68060f10 0x7fac680bbb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fac680664e0 tx=0x7fac5c006ef0).ready entity=mon.2 client_cookie=9ab6901aa485e30c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.060 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac65d9b700 1 -- 172.21.15.204:0/1366035559 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00b680 con 0x7fac68060f10 2020-11-20T11:17:45.060 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac65d9b700 1 -- 172.21.15.204:0/1366035559 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c000e90 con 0x7fac68060f10 2020-11-20T11:17:45.061 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac65d9b700 1 -- 172.21.15.204:0/1366035559 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00b9f0 con 0x7fac68060f10 2020-11-20T11:17:45.061 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6d1de700 1 -- 172.21.15.204:0/1366035559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68060f10 msgr2=0x7fac680bbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.061 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.053+0000 7fac6d1de700 1 --2- 172.21.15.204:0/1366035559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68060f10 0x7fac680bbb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fac680664e0 tx=0x7fac5c006ef0).stop 2020-11-20T11:17:45.061 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 -- 172.21.15.204:0/1366035559 shutdown_connections 2020-11-20T11:17:45.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.166:3300/0 conn(0x7fac680bc030 0x7fac6814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 --2- 172.21.15.204:0/1366035559 >> v2:172.21.15.112:3300/0 conn(0x7fac68064b90 0x7fac68064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 --2- 172.21.15.204:0/1366035559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68060f10 0x7fac680bbb40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 -- 172.21.15.204:0/1366035559 >> 172.21.15.204:0/1366035559 conn(0x7fac6805bac0 msgr2=0x7fac6805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.062 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 -- 172.21.15.204:0/1366035559 shutdown_connections 2020-11-20T11:17:45.063 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.054+0000 7fac6d1de700 1 -- 172.21.15.204:0/1366035559 wait complete. 2020-11-20T11:17:45.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.055+0000 7fac6d1de700 1 Processor -- start 2020-11-20T11:17:45.065 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.055+0000 7fac6d1de700 1 -- start start 2020-11-20T11:17:45.066 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 0x7fac6814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.066 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.066 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 0x7fac6815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.066 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6815e2c0 con 0x7fac680bc030 2020-11-20T11:17:45.066 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac681503d0 con 0x7fac68060f10 2020-11-20T11:17:45.067 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68142f30 con 0x7fac68064b90 2020-11-20T11:17:45.067 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6659c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.067 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6659c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47064/0 (socket says 172.21.15.204:47064) 2020-11-20T11:17:45.067 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 0x7fac6814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.068 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6659c700 1 -- 172.21.15.204:0/950156411 learned_addr learned my addr 172.21.15.204:0/950156411 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.068 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6759e700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 0x7fac6815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.068 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 -- 172.21.15.204:0/950156411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 msgr2=0x7fac68143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.068 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.068 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 -- 172.21.15.204:0/950156411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 msgr2=0x7fac6815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.069 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 0x7fac6815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.069 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 -- 172.21.15.204:0/950156411 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac681431d0 con 0x7fac68060f10 2020-11-20T11:17:45.069 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6759e700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 0x7fac6815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:45.069 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6659c700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:45.069 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac66d9d700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 0x7fac6814fd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fac5800eba0 tx=0x7fac58006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.070 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800be30 con 0x7fac68060f10 2020-11-20T11:17:45.070 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800c850 con 0x7fac68060f10 2020-11-20T11:17:45.070 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac68143470 con 0x7fac68060f10 2020-11-20T11:17:45.070 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800cbd0 con 0x7fac68060f10 2020-11-20T11:17:45.071 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.056+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac68142840 con 0x7fac68060f10 2020-11-20T11:17:45.071 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.057+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fac5801c6c0 con 0x7fac68060f10 2020-11-20T11:17:45.071 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.057+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fac5801c950 con 0x7fac68060f10 2020-11-20T11:17:45.071 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.057+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac680666e0 con 0x7fac68060f10 2020-11-20T11:17:45.071 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.060+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fac5801cbb0 con 0x7fac68060f10 2020-11-20T11:17:45.140 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.138+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c101d1b8-188b-4a96-a6c8-327b3d6e4b74", "id": 6} v 0) v1 -- 0x7fac6805ca90 con 0x7fac68060f10 2020-11-20T11:17:45.144 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.141+0000 7fac4effd700 1 -- 172.21.15.204:0/950156411 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c101d1b8-188b-4a96-a6c8-327b3d6e4b74", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac5802b0b0 con 0x7fac68060f10 2020-11-20T11:17:45.144 INFO:teuthology.orchestra.run.smithi204.stdout:6 2020-11-20T11:17:45.145 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 msgr2=0x7fac6814fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.146 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 0x7fac6814fd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fac5800eba0 tx=0x7fac58006e30).stop 2020-11-20T11:17:45.146 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 shutdown_connections 2020-11-20T11:17:45.146 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac680bc030 0x7fac6815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.146 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fac68060f10 0x7fac6814fd10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.147 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 --2- 172.21.15.204:0/950156411 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac68064b90 0x7fac68143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.147 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 >> 172.21.15.204:0/950156411 conn(0x7fac6805bac0 msgr2=0x7fac680be8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.147 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.142+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 shutdown_connections 2020-11-20T11:17:45.147 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.143+0000 7fac6d1de700 1 -- 172.21.15.204:0/950156411 wait complete. 2020-11-20T11:17:45.160 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 6cd744f2-abad-41dd-861f-9c3013306694 7 2020-11-20T11:17:45.271 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.268+0000 7f4581262700 1 Processor -- start 2020-11-20T11:17:45.271 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.268+0000 7f4581262700 1 -- start start 2020-11-20T11:17:45.273 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f4581262700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f457c066b60 0x7f457c066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.273 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f4581262700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f457c1518f0 0x7f457c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.274 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f4581262700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c151490 con 0x7f457c0bb8e0 2020-11-20T11:17:45.274 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f4581262700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c064510 con 0x7f457c066b60 2020-11-20T11:17:45.274 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f4581262700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c063a90 con 0x7f457c1518f0 2020-11-20T11:17:45.274 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f457c066b60 0x7f457c066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.274 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f457c066b60 0x7f457c066f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.204:36180/0 (socket says 172.21.15.204:36180) 2020-11-20T11:17:45.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 -- 172.21.15.204:0/275222319 learned_addr learned my addr 172.21.15.204:0/275222319 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457b7fe700 1 --2- 172.21.15.204:0/275222319 >> v2:172.21.15.166:3300/0 conn(0x7f457c1518f0 0x7f457c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 -- 172.21.15.204:0/275222319 >> v2:172.21.15.166:3300/0 conn(0x7f457c1518f0 msgr2=0x7f457c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:45.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 --2- 172.21.15.204:0/275222319 >> v2:172.21.15.166:3300/0 conn(0x7f457c1518f0 0x7f457c151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.275 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 -- 172.21.15.204:0/275222319 >> v1:172.21.15.166:6789/0 conn(0x7f457c0bb8e0 legacy=0x7f457c0c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.269+0000 7f457affd700 1 -- 172.21.15.204:0/275222319 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c063d30 con 0x7f457c066b60 2020-11-20T11:17:45.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f457affd700 1 --2- 172.21.15.204:0/275222319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c066f40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f457c0c0c60 tx=0x7f4570006ef0).ready entity=mon.0 client_cookie=f1e2d87b005d4ece server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4579ffb700 1 -- 172.21.15.204:0/275222319 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000b860 con 0x7f457c066b60 2020-11-20T11:17:45.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4579ffb700 1 -- 172.21.15.204:0/275222319 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570000e90 con 0x7f457c066b60 2020-11-20T11:17:45.276 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4579ffb700 1 -- 172.21.15.204:0/275222319 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000bbd0 con 0x7f457c066b60 2020-11-20T11:17:45.277 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 -- 172.21.15.204:0/275222319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 msgr2=0x7f457c066f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.277 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 --2- 172.21.15.204:0/275222319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c066f40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f457c0c0c60 tx=0x7f4570006ef0).stop 2020-11-20T11:17:45.277 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 -- 172.21.15.204:0/275222319 shutdown_connections 2020-11-20T11:17:45.277 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 --2- 172.21.15.204:0/275222319 >> v2:172.21.15.166:3300/0 conn(0x7f457c1518f0 0x7f457c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.278 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 --2- 172.21.15.204:0/275222319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c066f40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.278 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 -- 172.21.15.204:0/275222319 >> 172.21.15.204:0/275222319 conn(0x7f457c0bac60 msgr2=0x7f457c0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.278 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 -- 172.21.15.204:0/275222319 shutdown_connections 2020-11-20T11:17:45.278 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.270+0000 7f4581262700 1 -- 172.21.15.204:0/275222319 wait complete. 2020-11-20T11:17:45.280 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.271+0000 7f4581262700 1 Processor -- start 2020-11-20T11:17:45.281 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 -- start start 2020-11-20T11:17:45.281 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.281 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 0x7f457c14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.281 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f457c1518f0 0x7f457c0c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c52c0 con 0x7f457c066b60 2020-11-20T11:17:45.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1618b0 con 0x7f457c1518f0 2020-11-20T11:17:45.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f4581262700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c163fe0 con 0x7f457c0bb8e0 2020-11-20T11:17:45.282 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457a7fc700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 0x7f457c14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.204:36186/0 (socket says 172.21.15.204:36186) 2020-11-20T11:17:45.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457a7fc700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 0x7f457c14eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47076/0 (socket says 172.21.15.204:47076) 2020-11-20T11:17:45.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457affd700 1 -- 172.21.15.204:0/3102651534 learned_addr learned my addr 172.21.15.204:0/3102651534 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.283 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.272+0000 7f457b7fe700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f457c1518f0 0x7f457c0c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 -- 172.21.15.204:0/3102651534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 msgr2=0x7f457c14eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 0x7f457c14eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 -- 172.21.15.204:0/3102651534 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f457c1518f0 msgr2=0x7f457c0c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.284 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f457c1518f0 0x7f457c0c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.285 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 -- 172.21.15.204:0/3102651534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c164280 con 0x7f457c066b60 2020-11-20T11:17:45.285 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f457affd700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f457000b3c0 tx=0x7f4570016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.285 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700119f0 con 0x7f457c066b60 2020-11-20T11:17:45.285 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570011b50 con 0x7f457c066b60 2020-11-20T11:17:45.285 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c164520 con 0x7f457c066b60 2020-11-20T11:17:45.286 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457001c440 con 0x7f457c066b60 2020-11-20T11:17:45.286 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c164d00 con 0x7f457c066b60 2020-11-20T11:17:45.286 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f457002c070 con 0x7f457c066b60 2020-11-20T11:17:45.286 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.273+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f457001ca50 con 0x7f457c066b60 2020-11-20T11:17:45.287 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.274+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c0666e0 con 0x7f457c066b60 2020-11-20T11:17:45.287 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.276+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f457002a060 con 0x7f457c066b60 2020-11-20T11:17:45.355 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.353+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6cd744f2-abad-41dd-861f-9c3013306694", "id": 7} v 0) v1 -- 0x7f457c05d370 con 0x7f457c066b60 2020-11-20T11:17:45.359 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.356+0000 7f4562ffd700 1 -- 172.21.15.204:0/3102651534 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6cd744f2-abad-41dd-861f-9c3013306694", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4570020070 con 0x7f457c066b60 2020-11-20T11:17:45.359 INFO:teuthology.orchestra.run.smithi204.stdout:7 2020-11-20T11:17:45.360 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 msgr2=0x7f457c1613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.360 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f457000b3c0 tx=0x7f4570016000).stop 2020-11-20T11:17:45.360 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 shutdown_connections 2020-11-20T11:17:45.361 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f457c1518f0 0x7f457c0c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.361 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f457c066b60 0x7f457c1613c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.361 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 --2- 172.21.15.204:0/3102651534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f457c0bb8e0 0x7f457c14eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.361 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 >> 172.21.15.204:0/3102651534 conn(0x7f457c0bac60 msgr2=0x7f457c14c230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.362 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 shutdown_connections 2020-11-20T11:17:45.362 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.357+0000 7f4581262700 1 -- 172.21.15.204:0/3102651534 wait complete. 2020-11-20T11:17:45.371 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 19fa2d8f-a158-46f9-a390-7ffef109f626 8 2020-11-20T11:17:45.483 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.480+0000 7f90a4971700 1 Processor -- start 2020-11-20T11:17:45.483 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.480+0000 7f90a4971700 1 -- start start 2020-11-20T11:17:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f90a4971700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90a00c5a10 0x7f90a00c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f90a4971700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 0x7f90a0064720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f90a4971700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a01516b0 con 0x7f90a0155700 2020-11-20T11:17:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f90a4971700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a0155b60 con 0x7f90a00c5a10 2020-11-20T11:17:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f90a4971700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a01518e0 con 0x7f90a0061930 2020-11-20T11:17:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f909dd9b700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f90a0155700 0x7f90a0061220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51516/0 (socket says 172.21.15.204:51516) 2020-11-20T11:17:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f909dd9b700 1 -- 172.21.15.204:0/1010062979 learned_addr learned my addr 172.21.15.204:0/1010062979 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f909ed9d700 1 --2- 172.21.15.204:0/1010062979 >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 0x7f90a0064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.481+0000 7f909e59c700 1 --2- 172.21.15.204:0/1010062979 >> v2:172.21.15.112:3300/0 conn(0x7f90a00c5a10 0x7f90a00c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888408636 0 0) 0x7f90a01516b0 con 0x7f90a0155700 2020-11-20T11:17:45.488 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9084003280 con 0x7f90a0155700 2020-11-20T11:17:45.488 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909e59c700 1 -- 172.21.15.204:0/1010062979 >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 msgr2=0x7f90a0064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:45.488 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 <== mon.2 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1814803729 0 0) 0x7f9084003280 con 0x7f90a0155700 2020-11-20T11:17:45.488 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909e59c700 1 --2- 172.21.15.204:0/1010062979 >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 0x7f90a0064720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.488 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909e59c700 1 -- 172.21.15.204:0/1010062979 >> v1:172.21.15.204:6789/0 conn(0x7f90a0155700 legacy=0x7f90a0061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.489 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909e59c700 1 -- 172.21.15.204:0/1010062979 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0151b80 con 0x7f90a00c5a10 2020-11-20T11:17:45.489 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909ed9d700 1 --2- 172.21.15.204:0/1010062979 >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 0x7f90a0064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:45.489 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909e59c700 1 --2- 172.21.15.204:0/1010062979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00c5df0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f90a00805c0 tx=0x7f9090006e30).ready entity=mon.0 client_cookie=97c2ce7f8dfd5691 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.489 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094001520 con 0x7f90a00c5a10 2020-11-20T11:17:45.489 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090000e90 con 0x7f90a00c5a10 2020-11-20T11:17:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.482+0000 7f909d59a700 1 -- 172.21.15.204:0/1010062979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090011610 con 0x7f90a00c5a10 2020-11-20T11:17:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 -- 172.21.15.204:0/1010062979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 msgr2=0x7f90a00c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 --2- 172.21.15.204:0/1010062979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00c5df0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f90a00805c0 tx=0x7f9090006e30).stop 2020-11-20T11:17:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 -- 172.21.15.204:0/1010062979 shutdown_connections 2020-11-20T11:17:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 --2- 172.21.15.204:0/1010062979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00c5df0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 --2- 172.21.15.204:0/1010062979 >> v2:172.21.15.166:3300/0 conn(0x7f90a0061930 0x7f90a0064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 -- 172.21.15.204:0/1010062979 >> 172.21.15.204:0/1010062979 conn(0x7f90a00bbc50 msgr2=0x7f90a00bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 -- 172.21.15.204:0/1010062979 shutdown_connections 2020-11-20T11:17:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.483+0000 7f90a4971700 1 -- 172.21.15.204:0/1010062979 wait complete. 2020-11-20T11:17:45.494 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.484+0000 7f90a4971700 1 Processor -- start 2020-11-20T11:17:45.494 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.484+0000 7f90a4971700 1 -- start start 2020-11-20T11:17:45.494 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f90a0061930 0x7f90a00befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.494 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.495 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.495 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0150f80 con 0x7f90a00c5a10 2020-11-20T11:17:45.495 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00c2000 con 0x7f90a0061930 2020-11-20T11:17:45.495 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00c24d0 con 0x7f90a0155700 2020-11-20T11:17:45.495 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.496 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47090/0 (socket says 172.21.15.204:47090) 2020-11-20T11:17:45.496 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 -- 172.21.15.204:0/848970784 learned_addr learned my addr 172.21.15.204:0/848970784 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.496 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909e59c700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f90a0061930 0x7f90a00befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.496 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909dd9b700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.496 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 -- 172.21.15.204:0/848970784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f90a0061930 msgr2=0x7f90a00befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.497 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f90a0061930 0x7f90a00befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.497 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 -- 172.21.15.204:0/848970784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 msgr2=0x7f90a00bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.497 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00bf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.497 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 -- 172.21.15.204:0/848970784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00c2230 con 0x7f90a0155700 2020-11-20T11:17:45.498 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f909ed9d700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f909800ef80 tx=0x7f9098009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.498 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800cc90 con 0x7f90a0155700 2020-11-20T11:17:45.498 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800cdf0 con 0x7f90a0155700 2020-11-20T11:17:45.498 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098012620 con 0x7f90a0155700 2020-11-20T11:17:45.498 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a00be030 con 0x7f90a0155700 2020-11-20T11:17:45.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.485+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a00be570 con 0x7f90a0155700 2020-11-20T11:17:45.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.486+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f9098022070 con 0x7f90a0155700 2020-11-20T11:17:45.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.486+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f909801bbf0 con 0x7f90a0155700 2020-11-20T11:17:45.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.486+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00be730 con 0x7f90a0155700 2020-11-20T11:17:45.499 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.490+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f909803a880 con 0x7f90a0155700 2020-11-20T11:17:45.570 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.567+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19fa2d8f-a158-46f9-a390-7ffef109f626", "id": 8} v 0) v1 -- 0x7f90a00666e0 con 0x7f90a0155700 2020-11-20T11:17:45.573 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.571+0000 7f908e7fc700 1 -- 172.21.15.204:0/848970784 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19fa2d8f-a158-46f9-a390-7ffef109f626", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9098029030 con 0x7f90a0155700 2020-11-20T11:17:45.574 INFO:teuthology.orchestra.run.smithi204.stdout:8 2020-11-20T11:17:45.575 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 msgr2=0x7f90a0163ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.575 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f909800ef80 tx=0x7f9098009220).stop 2020-11-20T11:17:45.575 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 shutdown_connections 2020-11-20T11:17:45.576 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90a0155700 0x7f90a0163ea0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.576 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f90a0061930 0x7f90a00befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.576 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 --2- 172.21.15.204:0/848970784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90a00c5a10 0x7f90a00bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.576 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 >> 172.21.15.204:0/848970784 conn(0x7f90a00bbc50 msgr2=0x7f90a0154c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.577 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 shutdown_connections 2020-11-20T11:17:45.577 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.572+0000 7f90a4971700 1 -- 172.21.15.204:0/848970784 wait complete. 2020-11-20T11:17:45.587 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 3edbfb9c-833c-4d50-9268-fc07ce6430be 9 2020-11-20T11:17:45.700 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.697+0000 7f81527d3700 1 Processor -- start 2020-11-20T11:17:45.700 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.697+0000 7f81527d3700 1 -- start start 2020-11-20T11:17:45.702 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f81527d3700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 0x7f814c066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.703 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f81527d3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f814c1512e0 0x7f814c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.703 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f81527d3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c0c5230 con 0x7f814c0bfa50 2020-11-20T11:17:45.703 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f81527d3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c1549c0 con 0x7f814c1512e0 2020-11-20T11:17:45.703 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f81527d3700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c154c60 con 0x7f814c065d30 2020-11-20T11:17:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814bfff700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 0x7f814c066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f8150d70700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f814c1512e0 0x7f814c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814b7fe700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f814c0bfa50 0x7f814c0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.204:39002/0 (socket says 172.21.15.204:39002) 2020-11-20T11:17:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814b7fe700 1 -- 172.21.15.204:0/3595968490 learned_addr learned my addr 172.21.15.204:0/3595968490 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814affd700 1 -- 172.21.15.204:0/3595968490 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755141389 0 0) 0x7f814c0c5230 con 0x7f814c0bfa50 2020-11-20T11:17:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814affd700 1 -- 172.21.15.204:0/3595968490 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8138003280 con 0x7f814c0bfa50 2020-11-20T11:17:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f8150d70700 1 -- 172.21.15.204:0/3595968490 >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 msgr2=0x7f814c066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f8150d70700 1 --2- 172.21.15.204:0/3595968490 >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 0x7f814c066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f8150d70700 1 -- 172.21.15.204:0/3595968490 >> v1:172.21.15.166:6789/0 conn(0x7f814c0bfa50 legacy=0x7f814c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f8150d70700 1 -- 172.21.15.204:0/3595968490 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c154f00 con 0x7f814c1512e0 2020-11-20T11:17:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.698+0000 7f814bfff700 1 --2- 172.21.15.204:0/3595968490 >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 0x7f814c066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f8150d70700 1 --2- 172.21.15.204:0/3595968490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c151710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f814c0c79a0 tx=0x7f8144009220).ready entity=mon.0 client_cookie=bbe23af99395c82e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f814affd700 1 -- 172.21.15.204:0/3595968490 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400b950 con 0x7f814c1512e0 2020-11-20T11:17:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f814affd700 1 -- 172.21.15.204:0/3595968490 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400bab0 con 0x7f814c1512e0 2020-11-20T11:17:45.707 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f814affd700 1 -- 172.21.15.204:0/3595968490 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400be30 con 0x7f814c1512e0 2020-11-20T11:17:45.707 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 -- 172.21.15.204:0/3595968490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 msgr2=0x7f814c151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.707 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 --2- 172.21.15.204:0/3595968490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c151710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f814c0c79a0 tx=0x7f8144009220).stop 2020-11-20T11:17:45.707 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 -- 172.21.15.204:0/3595968490 shutdown_connections 2020-11-20T11:17:45.707 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 --2- 172.21.15.204:0/3595968490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c151710 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.708 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 --2- 172.21.15.204:0/3595968490 >> v2:172.21.15.166:3300/0 conn(0x7f814c065d30 0x7f814c066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.708 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 -- 172.21.15.204:0/3595968490 >> 172.21.15.204:0/3595968490 conn(0x7f814c05bac0 msgr2=0x7f814c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.708 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 -- 172.21.15.204:0/3595968490 shutdown_connections 2020-11-20T11:17:45.708 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.699+0000 7f81527d3700 1 -- 172.21.15.204:0/3595968490 wait complete. 2020-11-20T11:17:45.711 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.700+0000 7f81527d3700 1 Processor -- start 2020-11-20T11:17:45.711 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 -- start start 2020-11-20T11:17:45.711 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.711 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 0x7f814c160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c161360 con 0x7f814c1512e0 2020-11-20T11:17:45.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0c59d0 con 0x7f814c0bfa50 2020-11-20T11:17:45.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.701+0000 7f81527d3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0c5c70 con 0x7f814c065d30 2020-11-20T11:17:45.712 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.713 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814bfff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47098/0 (socket says 172.21.15.204:47098) 2020-11-20T11:17:45.713 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814bfff700 1 -- 172.21.15.204:0/4152339808 learned_addr learned my addr 172.21.15.204:0/4152339808 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.713 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 0x7f814c160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.713 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f8150d70700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.714 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 -- 172.21.15.204:0/4152339808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 msgr2=0x7f814c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.714 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.714 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 -- 172.21.15.204:0/4152339808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 msgr2=0x7f814c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.714 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.714 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 -- 172.21.15.204:0/4152339808 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0c5f10 con 0x7f814c0bfa50 2020-11-20T11:17:45.715 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814bfff700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:17:45.715 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f814b7fe700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 0x7f814c160e70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f813c007fd0 tx=0x7f813c007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.715 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0072e0 con 0x7f814c0bfa50 2020-11-20T11:17:45.715 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c007440 con 0x7f814c0bfa50 2020-11-20T11:17:45.715 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c0c61b0 con 0x7f814c0bfa50 2020-11-20T11:17:45.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c005880 con 0x7f814c0bfa50 2020-11-20T11:17:45.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c161840 con 0x7f814c0bfa50 2020-11-20T11:17:45.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f813c010070 con 0x7f814c0bfa50 2020-11-20T11:17:45.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.702+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7f813c013e40 con 0x7f814c0bfa50 2020-11-20T11:17:45.716 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.703+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c0666e0 con 0x7f814c0bfa50 2020-11-20T11:17:45.717 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.705+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f813c018020 con 0x7f814c0bfa50 2020-11-20T11:17:45.785 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.782+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3edbfb9c-833c-4d50-9268-fc07ce6430be", "id": 9} v 0) v1 -- 0x7f814c065740 con 0x7f814c0bfa50 2020-11-20T11:17:45.788 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.786+0000 7f812bfff700 1 -- 172.21.15.204:0/4152339808 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3edbfb9c-833c-4d50-9268-fc07ce6430be", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f813c005e50 con 0x7f814c0bfa50 2020-11-20T11:17:45.789 INFO:teuthology.orchestra.run.smithi204.stdout:9 2020-11-20T11:17:45.790 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 msgr2=0x7f814c160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.790 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 0x7f814c160e70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f813c007fd0 tx=0x7f813c007a20).stop 2020-11-20T11:17:45.790 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 shutdown_connections 2020-11-20T11:17:45.790 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f814c1512e0 0x7f814c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.791 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f814c065d30 0x7f814c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.791 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 --2- 172.21.15.204:0/4152339808 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f814c0bfa50 0x7f814c160e70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.791 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 >> 172.21.15.204:0/4152339808 conn(0x7f814c05bac0 msgr2=0x7f814c0c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.791 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 shutdown_connections 2020-11-20T11:17:45.791 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.787+0000 7f81527d3700 1 -- 172.21.15.204:0/4152339808 wait complete. 2020-11-20T11:17:45.801 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 01bcb4f2-04a5-4e09-9a98-c108f0cea3fa 10 2020-11-20T11:17:45.912 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.909+0000 7fe8aa649700 1 Processor -- start 2020-11-20T11:17:45.913 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.910+0000 7fe8aa649700 1 -- start start 2020-11-20T11:17:45.914 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.910+0000 7fe8aa649700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8a4152000 0x7fe8a40bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.915 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.910+0000 7fe8aa649700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a4151490 con 0x7fe8a4066b60 2020-11-20T11:17:45.915 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.910+0000 7fe8aa649700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a4064510 con 0x7fe8a4066f40 2020-11-20T11:17:45.915 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.910+0000 7fe8aa649700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40bbdd0 con 0x7fe8a4152000 2020-11-20T11:17:45.915 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8a4152000 0x7fe8a40bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.916 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8a4152000 0x7fe8a40bb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47104/0 (socket says 172.21.15.204:47104) 2020-11-20T11:17:45.916 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 -- 172.21.15.204:0/2373468829 learned_addr learned my addr 172.21.15.204:0/2373468829 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.916 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 -- 172.21.15.204:0/2373468829 >> v1:172.21.15.166:6789/0 conn(0x7fe8a4066f40 legacy=0x7fe8a41518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.916 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 -- 172.21.15.204:0/2373468829 >> v1:172.21.15.112:6789/0 conn(0x7fe8a4066b60 legacy=0x7fe8a40c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.916 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 -- 172.21.15.204:0/2373468829 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4063a90 con 0x7fe8a4152000 2020-11-20T11:17:45.917 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a8be6700 1 --2- 172.21.15.204:0/2373468829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4152000 0x7fe8a40bb8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe89c009d90 tx=0x7fe89c0092d0).ready entity=mon.2 client_cookie=1110041720b946cd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.917 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a2ffd700 1 -- 172.21.15.204:0/2373468829 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00bbf0 con 0x7fe8a4152000 2020-11-20T11:17:45.917 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a2ffd700 1 -- 172.21.15.204:0/2373468829 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00bd50 con 0x7fe8a4152000 2020-11-20T11:17:45.917 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.911+0000 7fe8a2ffd700 1 -- 172.21.15.204:0/2373468829 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c011610 con 0x7fe8a4152000 2020-11-20T11:17:45.918 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 -- 172.21.15.204:0/2373468829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4152000 msgr2=0x7fe8a40bb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.918 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 --2- 172.21.15.204:0/2373468829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4152000 0x7fe8a40bb8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe89c009d90 tx=0x7fe89c0092d0).stop 2020-11-20T11:17:45.918 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 -- 172.21.15.204:0/2373468829 shutdown_connections 2020-11-20T11:17:45.918 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 --2- 172.21.15.204:0/2373468829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4152000 0x7fe8a40bb8e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.918 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 -- 172.21.15.204:0/2373468829 >> 172.21.15.204:0/2373468829 conn(0x7fe8a40bac60 msgr2=0x7fe8a40bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:45.919 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 -- 172.21.15.204:0/2373468829 shutdown_connections 2020-11-20T11:17:45.919 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.912+0000 7fe8aa649700 1 -- 172.21.15.204:0/2373468829 wait complete. 2020-11-20T11:17:45.921 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.913+0000 7fe8aa649700 1 Processor -- start 2020-11-20T11:17:45.921 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.913+0000 7fe8aa649700 1 -- start start 2020-11-20T11:17:45.922 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe8a4066b60 0x7fe8a40c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.922 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.922 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a4152000 0x7fe8a4148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:45.922 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4061240 con 0x7fe8a4152000 2020-11-20T11:17:45.923 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40bd730 con 0x7fe8a4066b60 2020-11-20T11:17:45.923 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8aa649700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40bd1f0 con 0x7fe8a4066f40 2020-11-20T11:17:45.923 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.923 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47110/0 (socket says 172.21.15.204:47110) 2020-11-20T11:17:45.923 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 -- 172.21.15.204:0/1961990132 learned_addr learned my addr 172.21.15.204:0/1961990132 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:45.924 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a8be6700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a4152000 0x7fe8a4148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.924 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a3fff700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe8a4066b60 0x7fe8a40c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:45.924 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 -- 172.21.15.204:0/1961990132 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe8a4066b60 msgr2=0x7fe8a40c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.924 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe8a4066b60 0x7fe8a40c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.924 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 -- 172.21.15.204:0/1961990132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a4152000 msgr2=0x7fe8a4148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:45.925 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a4152000 0x7fe8a4148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:45.925 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 -- 172.21.15.204:0/1961990132 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40bd490 con 0x7fe8a4066f40 2020-11-20T11:17:45.925 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.914+0000 7fe8a37fe700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe89400c710 tx=0x7fe894007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:45.925 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894001ea0 con 0x7fe8a4066f40 2020-11-20T11:17:45.925 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894013410 con 0x7fe8a4066f40 2020-11-20T11:17:45.926 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940137b0 con 0x7fe8a4066f40 2020-11-20T11:17:45.926 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a40614a0 con 0x7fe8a4066f40 2020-11-20T11:17:45.926 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a4149980 con 0x7fe8a4066f40 2020-11-20T11:17:45.926 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe894010030 con 0x7fe8a4066f40 2020-11-20T11:17:45.927 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7fe89400ebb0 con 0x7fe8a4066f40 2020-11-20T11:17:45.927 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.915+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a40666e0 con 0x7fe8a4066f40 2020-11-20T11:17:45.927 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.918+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe89400e3d0 con 0x7fe8a4066f40 2020-11-20T11:17:45.998 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.995+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01bcb4f2-04a5-4e09-9a98-c108f0cea3fa", "id": 10} v 0) v1 -- 0x7fe8a405d370 con 0x7fe8a4066f40 2020-11-20T11:17:46.001 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:45.999+0000 7fe89bfff700 1 -- 172.21.15.204:0/1961990132 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01bcb4f2-04a5-4e09-9a98-c108f0cea3fa", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7fe89400e570 con 0x7fe8a4066f40 2020-11-20T11:17:46.001 INFO:teuthology.orchestra.run.smithi204.stdout:10 2020-11-20T11:17:46.002 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 msgr2=0x7fe8a4061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.003 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe89400c710 tx=0x7fe894007c40).stop 2020-11-20T11:17:46.003 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 shutdown_connections 2020-11-20T11:17:46.003 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a4152000 0x7fe8a4148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.003 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe8a4066b60 0x7fe8a40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.004 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 --2- 172.21.15.204:0/1961990132 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8a4066f40 0x7fe8a4061be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.004 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 >> 172.21.15.204:0/1961990132 conn(0x7fe8a40bac60 msgr2=0x7fe8a40bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:46.004 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 shutdown_connections 2020-11-20T11:17:46.004 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.000+0000 7fe8aa649700 1 -- 172.21.15.204:0/1961990132 wait complete. 2020-11-20T11:17:46.013 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a14fc070-26a3-45cd-9e46-c3dee9296758 11 2020-11-20T11:17:46.125 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.122+0000 7f61f3068700 1 Processor -- start 2020-11-20T11:17:46.125 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.122+0000 7f61f3068700 1 -- start start 2020-11-20T11:17:46.127 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f3068700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61ec061570 0x7f61ec14e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:46.127 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f3068700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec14f0b0 con 0x7f61ec1519a0 2020-11-20T11:17:46.128 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f3068700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0befc0 con 0x7f61ec14ec20 2020-11-20T11:17:46.128 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f3068700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0bf260 con 0x7f61ec061570 2020-11-20T11:17:46.128 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61ebfff700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61ec061570 0x7f61ec14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:46.128 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f1605700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f61ec14ec20 0x7f61ec0c0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:51548/0 (socket says 172.21.15.204:51548) 2020-11-20T11:17:46.128 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.123+0000 7f61f1605700 1 -- 172.21.15.204:0/4067958386 learned_addr learned my addr 172.21.15.204:0/4067958386 (peer_addr_for_me v1:172.21.15.204:0/0) 2020-11-20T11:17:46.129 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61ebfff700 1 -- 172.21.15.204:0/4067958386 >> v1:172.21.15.204:6789/0 conn(0x7f61ec14ec20 legacy=0x7f61ec0c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.129 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61ebfff700 1 -- 172.21.15.204:0/4067958386 >> v1:172.21.15.112:6789/0 conn(0x7f61ec1519a0 legacy=0x7f61ec151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.129 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61ebfff700 1 -- 172.21.15.204:0/4067958386 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0bfab0 con 0x7f61ec061570 2020-11-20T11:17:46.129 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61ebfff700 1 --2- 172.21.15.204:0/4067958386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec14e730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f61d800ba00 tx=0x7f61d8006e30).ready entity=mon.2 client_cookie=5dd405179de627c8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:46.129 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61eb7fe700 1 -- 172.21.15.204:0/4067958386 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d80097a0 con 0x7f61ec061570 2020-11-20T11:17:46.130 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61eb7fe700 1 -- 172.21.15.204:0/4067958386 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d8000e90 con 0x7f61ec061570 2020-11-20T11:17:46.130 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.124+0000 7f61eb7fe700 1 -- 172.21.15.204:0/4067958386 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8009b10 con 0x7f61ec061570 2020-11-20T11:17:46.130 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 -- 172.21.15.204:0/4067958386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 msgr2=0x7f61ec14e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.130 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 --2- 172.21.15.204:0/4067958386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec14e730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f61d800ba00 tx=0x7f61d8006e30).stop 2020-11-20T11:17:46.130 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 -- 172.21.15.204:0/4067958386 shutdown_connections 2020-11-20T11:17:46.131 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 --2- 172.21.15.204:0/4067958386 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec14e730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.131 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 -- 172.21.15.204:0/4067958386 >> 172.21.15.204:0/4067958386 conn(0x7f61ec05bac0 msgr2=0x7f61ec0669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:46.131 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 -- 172.21.15.204:0/4067958386 shutdown_connections 2020-11-20T11:17:46.131 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.125+0000 7f61f3068700 1 -- 172.21.15.204:0/4067958386 wait complete. 2020-11-20T11:17:46.134 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.126+0000 7f61f3068700 1 Processor -- start 2020-11-20T11:17:46.134 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.126+0000 7f61f3068700 1 -- start start 2020-11-20T11:17:46.134 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:46.134 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ec14ec20 0x7f61ec063150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:46.135 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f61ec1519a0 0x7f61ec1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:46.135 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec111670 con 0x7f61ec14ec20 2020-11-20T11:17:46.135 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec111130 con 0x7f61ec1519a0 2020-11-20T11:17:46.135 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1113d0 con 0x7f61ec061570 2020-11-20T11:17:46.135 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:46.136 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47120/0 (socket says 172.21.15.204:47120) 2020-11-20T11:17:46.136 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 -- 172.21.15.204:0/184292266 learned_addr learned my addr 172.21.15.204:0/184292266 (peer_addr_for_me v2:172.21.15.204:0/0) 2020-11-20T11:17:46.136 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61ebfff700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ec14ec20 0x7f61ec063150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:46.136 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f1605700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f61ec1519a0 0x7f61ec1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:46.136 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 -- 172.21.15.204:0/184292266 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f61ec1519a0 msgr2=0x7f61ec1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.137 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f61ec1519a0 0x7f61ec1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.137 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 -- 172.21.15.204:0/184292266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ec14ec20 msgr2=0x7f61ec063150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.137 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ec14ec20 0x7f61ec063150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.137 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 -- 172.21.15.204:0/184292266 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec10e7a0 con 0x7f61ec061570 2020-11-20T11:17:46.137 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f0e04700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f61e000c710 tx=0x7f61e0007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:46.138 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000e4a0 con 0x7f61ec061570 2020-11-20T11:17:46.138 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0001e90 con 0x7f61ec061570 2020-11-20T11:17:46.138 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec10ea40 con 0x7f61ec061570 2020-11-20T11:17:46.138 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000e830 con 0x7f61ec061570 2020-11-20T11:17:46.138 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.127+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec110d50 con 0x7f61ec061570 2020-11-20T11:17:46.139 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.128+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f61e0010030 con 0x7f61ec061570 2020-11-20T11:17:46.139 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.128+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2019+0+0 (secure 0 0 0) 0x7f61e003c720 con 0x7f61ec061570 2020-11-20T11:17:46.139 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.128+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec0666e0 con 0x7f61ec061570 2020-11-20T11:17:46.139 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.130+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f61e00119b0 con 0x7f61ec061570 2020-11-20T11:17:46.209 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.206+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a14fc070-26a3-45cd-9e46-c3dee9296758", "id": 11} v 0) v1 -- 0x7f61ec061e70 con 0x7f61ec061570 2020-11-20T11:17:46.213 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.211+0000 7f61e8ff9700 1 -- 172.21.15.204:0/184292266 <== mon.2 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a14fc070-26a3-45cd-9e46-c3dee9296758", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f61e0012e60 con 0x7f61ec061570 2020-11-20T11:17:46.213 INFO:teuthology.orchestra.run.smithi204.stdout:11 2020-11-20T11:17:46.214 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.211+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 msgr2=0x7f61ec15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:46.215 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.211+0000 7f61f3068700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f61e000c710 tx=0x7f61e0007c40).stop 2020-11-20T11:17:46.215 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 shutdown_connections 2020-11-20T11:17:46.215 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f61ec1519a0 0x7f61ec1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.215 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61ec061570 0x7f61ec15f5a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.215 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 --2- 172.21.15.204:0/184292266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61ec14ec20 0x7f61ec063150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:46.216 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 >> 172.21.15.204:0/184292266 conn(0x7f61ec05bac0 msgr2=0x7f61ec060bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:46.216 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 shutdown_connections 2020-11-20T11:17:46.216 INFO:teuthology.orchestra.run.smithi204.stderr:2020-11-20T11:17:46.212+0000 7f61f3068700 1 -- 172.21.15.204:0/184292266 wait complete. 2020-11-20T11:17:46.225 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T11:17:46.226 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T11:17:46.228 INFO:tasks.ceph.osd.0:Started 2020-11-20T11:17:46.229 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T11:17:46.229 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T11:17:46.231 INFO:tasks.ceph.osd.3:Started 2020-11-20T11:17:46.232 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T11:17:46.232 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T11:17:46.234 INFO:tasks.ceph.osd.6:Started 2020-11-20T11:17:46.234 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T11:17:46.235 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T11:17:46.236 INFO:tasks.ceph.osd.9:Started 2020-11-20T11:17:46.237 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T11:17:46.237 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T11:17:46.239 INFO:tasks.ceph.osd.1:Started 2020-11-20T11:17:46.240 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T11:17:46.240 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T11:17:46.242 INFO:tasks.ceph.osd.4:Started 2020-11-20T11:17:46.242 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T11:17:46.243 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T11:17:46.244 INFO:tasks.ceph.osd.7:Started 2020-11-20T11:17:46.245 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T11:17:46.245 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T11:17:46.247 INFO:tasks.ceph.osd.10:Started 2020-11-20T11:17:46.248 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T11:17:46.248 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T11:17:46.250 INFO:tasks.ceph.osd.2:Started 2020-11-20T11:17:46.251 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T11:17:46.251 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T11:17:46.253 INFO:tasks.ceph.osd.5:Started 2020-11-20T11:17:46.253 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T11:17:46.254 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T11:17:46.256 INFO:tasks.ceph.osd.8:Started 2020-11-20T11:17:46.256 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T11:17:46.257 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T11:17:46.258 INFO:tasks.ceph.osd.11:Started 2020-11-20T11:17:46.259 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T11:17:46.571 INFO:tasks.ceph.osd.0.smithi112.stderr:2020-11-20T11:17:46.568+0000 7fec45280f40 -1 Falling back to public interface 2020-11-20T11:17:46.818 INFO:tasks.ceph.osd.3.smithi112.stderr:2020-11-20T11:17:46.815+0000 7f1c1f683f40 -1 Falling back to public interface 2020-11-20T11:17:46.827 INFO:tasks.ceph.osd.6.smithi112.stderr:2020-11-20T11:17:46.824+0000 7f5e87b82f40 -1 Falling back to public interface 2020-11-20T11:17:46.827 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-20T11:17:46.824+0000 7f82f66abf40 -1 Falling back to public interface 2020-11-20T11:17:46.828 INFO:tasks.ceph.osd.9.smithi112.stderr:2020-11-20T11:17:46.825+0000 7f2f7f77af40 -1 Falling back to public interface 2020-11-20T11:17:46.831 INFO:tasks.ceph.osd.7.smithi166.stderr:2020-11-20T11:17:46.828+0000 7feaf027bf40 -1 Falling back to public interface 2020-11-20T11:17:46.840 INFO:tasks.ceph.osd.2.smithi204.stderr:2020-11-20T11:17:46.837+0000 7f6515f91f40 -1 Falling back to public interface 2020-11-20T11:17:46.841 INFO:tasks.ceph.osd.10.smithi166.stderr:2020-11-20T11:17:46.838+0000 7f9b19465f40 -1 Falling back to public interface 2020-11-20T11:17:46.843 INFO:tasks.ceph.osd.4.smithi166.stderr:2020-11-20T11:17:46.841+0000 7f563efd3f40 -1 Falling back to public interface 2020-11-20T11:17:46.844 INFO:tasks.ceph.osd.5.smithi204.stderr:2020-11-20T11:17:46.841+0000 7f25d3fd2f40 -1 Falling back to public interface 2020-11-20T11:17:46.849 INFO:tasks.ceph.osd.11.smithi204.stderr:2020-11-20T11:17:46.846+0000 7fadc3424f40 -1 Falling back to public interface 2020-11-20T11:17:46.850 INFO:tasks.ceph.osd.8.smithi204.stderr:2020-11-20T11:17:46.848+0000 7fd19accef40 -1 Falling back to public interface 2020-11-20T11:17:47.466 INFO:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:17:47.571 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.568+0000 7f0c30fc2700 1 Processor -- start 2020-11-20T11:17:47.571 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.568+0000 7f0c30fc2700 1 -- start start 2020-11-20T11:17:47.572 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c30fc2700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0c2c0bfe20 0x7f0c2c0c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.573 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c30fc2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c0c0af0 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.573 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c30fc2700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c0c0d90 con 0x7f0c2c0c4af0 2020-11-20T11:17:47.573 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c30fc2700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c0c1570 con 0x7f0c2c0bfe20 2020-11-20T11:17:47.574 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c2a59c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0c2c0bfa40 0x7f0c2c0c43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34142/0 (socket says 172.21.15.112:34142) 2020-11-20T11:17:47.574 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c2a59c700 1 -- 172.21.15.112:0/927670858 learned_addr learned my addr 172.21.15.112:0/927670858 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:47.574 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168776069 0 0) 0x7f0c2c0c0af0 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.575 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c0c003280 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.575 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.569+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/927670858 >> v2:172.21.15.204:3300/0 conn(0x7f0c2c0bfe20 0x7f0c2c0c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.575 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017216711 0 0) 0x7f0c2c0c0d90 con 0x7f0c2c0c4af0 2020-11-20T11:17:47.584 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c0c0af0 con 0x7f0c2c0c4af0 2020-11-20T11:17:47.584 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2343125634 0 0) 0x7f0c0c003280 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.584 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 >> v2:172.21.15.204:3300/0 conn(0x7f0c2c0bfe20 msgr2=0x7f0c2c0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:47.585 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 --2- 172.21.15.112:0/927670858 >> v2:172.21.15.204:3300/0 conn(0x7f0c2c0bfe20 0x7f0c2c0c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.585 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 >> v1:172.21.15.166:6789/0 conn(0x7f0c2c0c4af0 legacy=0x7f0c2c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.585 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c0c1030 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.586 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f0c1c001520 con 0x7f0c2c0bfa40 2020-11-20T11:17:47.586 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 >> v1:172.21.15.112:6789/0 conn(0x7f0c2c0bfa40 legacy=0x7f0c2c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.586 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c003950 0x7f0c0c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.586 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c0c004520 0x7f0c0c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.587 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 0x7f0c0c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.587 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0c1570 con 0x7f0c0c004e90 2020-11-20T11:17:47.587 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c00bc60 con 0x7f0c0c004520 2020-11-20T11:17:47.588 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c00bda0 con 0x7f0c0c003950 2020-11-20T11:17:47.588 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 0x7f0c0c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.588 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2a59c700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c003950 0x7f0c0c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.589 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c23fff700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c0c004520 0x7f0c0c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.589 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/927670858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c003950 msgr2=0x7f0c0c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:47.589 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c003950 0x7f0c0c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.589 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/927670858 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c0c004520 msgr2=0x7f0c0c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:47.590 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c0c004520 0x7f0c0c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.590 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/927670858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c003280 con 0x7f0c0c004e90 2020-11-20T11:17:47.590 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/927670858 reap_dead start 2020-11-20T11:17:47.591 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 0x7f0c0c00b770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0c24009ef0 tx=0x7f0c24009220).ready entity=mon.0 client_cookie=b690fc40f700f63f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:47.591 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24009610 con 0x7f0c0c004e90 2020-11-20T11:17:47.591 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2400ec80 con 0x7f0c0c004e90 2020-11-20T11:17:47.591 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.570+0000 7f0c29d9b700 1 -- 172.21.15.112:0/927670858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c240123f0 con 0x7f0c0c004e90 2020-11-20T11:17:47.591 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 -- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 msgr2=0x7f0c0c00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.592 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 0x7f0c0c00b770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0c24009ef0 tx=0x7f0c24009220).stop 2020-11-20T11:17:47.592 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 -- 172.21.15.112:0/927670858 shutdown_connections 2020-11-20T11:17:47.592 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 --2- 172.21.15.112:0/927670858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c0c004e90 0x7f0c0c00b770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.592 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 -- 172.21.15.112:0/927670858 >> 172.21.15.112:0/927670858 conn(0x7f0c2c0bde60 msgr2=0x7f0c2c0be270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:47.593 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 -- 172.21.15.112:0/927670858 shutdown_connections 2020-11-20T11:17:47.593 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.571+0000 7f0c30fc2700 1 -- 172.21.15.112:0/927670858 wait complete. 2020-11-20T11:17:47.593 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.572+0000 7f0c30fc2700 1 Processor -- start 2020-11-20T11:17:47.593 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.572+0000 7f0c30fc2700 1 -- start start 2020-11-20T11:17:47.594 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c004e90 0x7f0c2c061b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.594 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c2c062030 0x7f0c2c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.594 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.594 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c1561f0 con 0x7f0c2c157080 2020-11-20T11:17:47.595 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c1552d0 con 0x7f0c2c062030 2020-11-20T11:17:47.595 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c155570 con 0x7f0c0c004e90 2020-11-20T11:17:47.595 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.595 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49964/0 (socket says 172.21.15.112:49964) 2020-11-20T11:17:47.595 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/2182704494 learned_addr learned my addr 172.21.15.112:0/2182704494 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:47.596 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2a59c700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c004e90 0x7f0c2c061b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.596 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/2182704494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c004e90 msgr2=0x7f0c2c061b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.596 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c004e90 0x7f0c2c061b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.596 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c23fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c2c062030 0x7f0c2c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.597 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c2c062030 msgr2=0x7f0c2c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.597 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c2c062030 0x7f0c2c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.597 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 -- 172.21.15.112:0/2182704494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c155810 con 0x7f0c2c157080 2020-11-20T11:17:47.597 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c2ad9d700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0c24008000 tx=0x7f0c24019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:47.597 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2401a400 con 0x7f0c2c157080 2020-11-20T11:17:47.598 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2401a560 con 0x7f0c2c157080 2020-11-20T11:17:47.598 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 -- 172.21.15.112:0/2182704494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c155ab0 con 0x7f0c2c157080 2020-11-20T11:17:47.598 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2401a920 con 0x7f0c2c157080 2020-11-20T11:17:47.598 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.573+0000 7f0c30fc2700 1 -- 172.21.15.112:0/2182704494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c156900 con 0x7f0c2c157080 2020-11-20T11:17:47.598 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.574+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc004fd0 con 0x7f0c2c157080 2020-11-20T11:17:47.600 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.575+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 3) v1 ==== 101030+0+0 (secure 0 0 0) 0x7f0c2402d070 con 0x7f0c2c157080 2020-11-20T11:17:47.600 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.575+0000 7f0c227fc700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 0x7f0c08082a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:47.600 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.576+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2534+0+0 (secure 0 0 0) 0x7f0c240a2990 con 0x7f0c2c157080 2020-11-20T11:17:47.601 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.576+0000 7f0c2a59c700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 0x7f0c08082a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:47.601 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.576+0000 7f0c2a59c700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 0x7f0c08082a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0c1c007830 tx=0x7f0c2c0c0c80).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:47.601 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.579+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0c24078b70 con 0x7f0c2c157080 2020-11-20T11:17:47.723 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.720+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bfc003b30 con 0x7f0c2c157080 2020-11-20T11:17:47.724 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.721+0000 7f0c227fc700 1 -- 172.21.15.112:0/2182704494 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11483 (secure 0 0 0) 0x7f0c24016070 con 0x7f0c2c157080 2020-11-20T11:17:47.724 INFO:teuthology.misc.health.smithi112.stdout: 2020-11-20T11:17:47.724 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":15,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:17:47.209749+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:17:47.726 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 msgr2=0x7f0c08082a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.726 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 0x7f0c08082a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0c1c007830 tx=0x7f0c2c0c0c80).stop 2020-11-20T11:17:47.726 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 msgr2=0x7f0c2c14cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:47.726 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0c24008000 tx=0x7f0c24019000).stop 2020-11-20T11:17:47.727 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 shutdown_connections 2020-11-20T11:17:47.727 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0c080805c0 0x7f0c08082a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.727 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c2c157080 0x7f0c2c14cf70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.727 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0c004e90 0x7f0c2c061b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.727 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 --2- 172.21.15.112:0/2182704494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0c2c062030 0x7f0c2c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:47.728 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.722+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 >> 172.21.15.112:0/2182704494 conn(0x7f0c2c0bde60 msgr2=0x7f0c2c0c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:47.728 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.723+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 shutdown_connections 2020-11-20T11:17:47.728 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:47.723+0000 7f0c03fff700 1 -- 172.21.15.112:0/2182704494 wait complete. 2020-11-20T11:17:47.737 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T11:17:47.903 INFO:tasks.ceph.osd.0.smithi112.stderr:2020-11-20T11:17:47.900+0000 7fec45280f40 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T11:17:48.142 INFO:tasks.ceph.osd.3.smithi112.stderr:2020-11-20T11:17:48.140+0000 7f1c1f683f40 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T11:17:48.152 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-20T11:17:48.150+0000 7f82f66abf40 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T11:17:48.168 INFO:tasks.ceph.osd.9.smithi112.stderr:2020-11-20T11:17:48.166+0000 7f2f7f77af40 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T11:17:48.169 INFO:tasks.ceph.osd.2.smithi204.stderr:2020-11-20T11:17:48.167+0000 7f6515f91f40 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T11:17:48.171 INFO:tasks.ceph.osd.6.smithi112.stderr:2020-11-20T11:17:48.169+0000 7f5e87b82f40 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T11:17:48.178 INFO:tasks.ceph.osd.7.smithi166.stderr:2020-11-20T11:17:48.175+0000 7feaf027bf40 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T11:17:48.180 INFO:tasks.ceph.osd.10.smithi166.stderr:2020-11-20T11:17:48.177+0000 7f9b19465f40 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T11:17:48.183 INFO:tasks.ceph.osd.5.smithi204.stderr:2020-11-20T11:17:48.181+0000 7f25d3fd2f40 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T11:17:48.187 INFO:tasks.ceph.osd.4.smithi166.stderr:2020-11-20T11:17:48.185+0000 7f563efd3f40 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T11:17:48.194 INFO:tasks.ceph.osd.8.smithi204.stderr:2020-11-20T11:17:48.192+0000 7fd19accef40 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T11:17:48.197 INFO:tasks.ceph.osd.11.smithi204.stderr:2020-11-20T11:17:48.195+0000 7fadc3424f40 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T11:17:48.285 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:48.288 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:48.290 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:17:49.560 INFO:tasks.ceph.osd.7.smithi166.stderr:2020-11-20T11:17:49.558+0000 7feae6a04700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T11:17:49.561 INFO:tasks.ceph.osd.2.smithi204.stderr:2020-11-20T11:17:49.558+0000 7f650c71a700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T11:17:49.561 INFO:tasks.ceph.osd.8.smithi204.stderr:2020-11-20T11:17:49.558+0000 7fd191457700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T11:17:49.562 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-20T11:17:49.558+0000 7f82ece34700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T11:17:49.564 INFO:tasks.ceph.osd.0.smithi112.stderr:2020-11-20T11:17:49.560+0000 7fec3ba09700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T11:17:49.565 INFO:tasks.ceph.osd.9.smithi112.stderr:2020-11-20T11:17:49.560+0000 7f2f75f03700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T11:17:49.565 INFO:tasks.ceph.osd.6.smithi112.stderr:2020-11-20T11:17:49.561+0000 7f5e7e30b700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T11:17:49.565 INFO:tasks.ceph.osd.3.smithi112.stderr:2020-11-20T11:17:49.562+0000 7f1c15e0c700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T11:17:49.566 INFO:tasks.ceph.osd.10.smithi166.stderr:2020-11-20T11:17:49.562+0000 7f9b0fbee700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T11:17:49.566 INFO:tasks.ceph.osd.5.smithi204.stderr:2020-11-20T11:17:49.561+0000 7f25ca75b700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T11:17:49.567 INFO:tasks.ceph.osd.4.smithi166.stderr:2020-11-20T11:17:49.564+0000 7f563575c700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T11:17:49.567 INFO:tasks.ceph.osd.11.smithi204.stderr:2020-11-20T11:17:49.565+0000 7fadb9bad700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T11:17:54.945 INFO:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:17:55.057 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.054+0000 7f2abd7cf700 1 Processor -- start 2020-11-20T11:17:55.057 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.054+0000 7f2abd7cf700 1 -- start start 2020-11-20T11:17:55.059 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abd7cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ab80627f0 0x7f2ab8062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.060 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abd7cf700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f2ab8150550 0x7f2ab81509a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.060 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abd7cf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab80be6e0 con 0x7f2ab8060290 2020-11-20T11:17:55.060 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abd7cf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80be980 con 0x7f2ab80627f0 2020-11-20T11:17:55.060 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abd7cf700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80bec20 con 0x7f2ab8150550 2020-11-20T11:17:55.061 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2ab7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ab80627f0 0x7f2ab8062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.061 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2ab7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ab80627f0 0x7f2ab8062bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50260/0 (socket says 172.21.15.112:50260) 2020-11-20T11:17:55.061 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2ab77fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2ab8060290 0x7f2ab80606d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34452/0 (socket says 172.21.15.112:34452) 2020-11-20T11:17:55.061 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2ab7fff700 1 -- 172.21.15.112:0/2332394551 learned_addr learned my addr 172.21.15.112:0/2332394551 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:55.061 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2abcfce700 1 --2- 172.21.15.112:0/2332394551 >> v2:172.21.15.166:3300/0 conn(0x7f2ab8150550 0x7f2ab81509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.062 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.055+0000 7f2ab7fff700 1 -- 172.21.15.112:0/2332394551 >> v2:172.21.15.166:3300/0 conn(0x7f2ab8150550 msgr2=0x7f2ab81509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:55.062 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab7fff700 1 --2- 172.21.15.112:0/2332394551 >> v2:172.21.15.166:3300/0 conn(0x7f2ab8150550 0x7f2ab81509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.062 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab7fff700 1 -- 172.21.15.112:0/2332394551 >> v1:172.21.15.112:6789/0 conn(0x7f2ab8060290 legacy=0x7f2ab80606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.062 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab6ffd700 1 -- 172.21.15.112:0/2332394551 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340485939 0 0) 0x7f2ab80be6e0 con 0x7f2ab8060290 2020-11-20T11:17:55.062 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab7fff700 1 -- 172.21.15.112:0/2332394551 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80beec0 con 0x7f2ab80627f0 2020-11-20T11:17:55.063 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab7fff700 1 --2- 172.21.15.112:0/2332394551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab8062bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ab8067330 tx=0x7f2aa8006ef0).ready entity=mon.0 client_cookie=7f54728d05095042 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.063 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab6ffd700 1 -- 172.21.15.112:0/2332394551 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800b8f0 con 0x7f2ab80627f0 2020-11-20T11:17:55.063 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab6ffd700 1 -- 172.21.15.112:0/2332394551 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8000e90 con 0x7f2ab80627f0 2020-11-20T11:17:55.063 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2ab6ffd700 1 -- 172.21.15.112:0/2332394551 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800bc60 con 0x7f2ab80627f0 2020-11-20T11:17:55.063 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 -- 172.21.15.112:0/2332394551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 msgr2=0x7f2ab8062bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.064 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/2332394551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab8062bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ab8067330 tx=0x7f2aa8006ef0).stop 2020-11-20T11:17:55.064 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 -- 172.21.15.112:0/2332394551 shutdown_connections 2020-11-20T11:17:55.064 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/2332394551 >> v2:172.21.15.166:3300/0 conn(0x7f2ab8150550 0x7f2ab81509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.064 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/2332394551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab8062bd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.064 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 -- 172.21.15.112:0/2332394551 >> 172.21.15.112:0/2332394551 conn(0x7f2ab8067380 msgr2=0x7f2ab80c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:55.065 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 -- 172.21.15.112:0/2332394551 shutdown_connections 2020-11-20T11:17:55.065 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.056+0000 7f2abd7cf700 1 -- 172.21.15.112:0/2332394551 wait complete. 2020-11-20T11:17:55.067 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.057+0000 7f2abd7cf700 1 Processor -- start 2020-11-20T11:17:55.068 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 -- start start 2020-11-20T11:17:55.068 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2ab8060290 0x7f2ab80bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.068 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.068 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ab8150550 0x7f2ab8060890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.069 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81619a0 con 0x7f2ab80627f0 2020-11-20T11:17:55.069 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80bcb90 con 0x7f2ab8060290 2020-11-20T11:17:55.069 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.058+0000 7f2abd7cf700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80bce30 con 0x7f2ab8150550 2020-11-20T11:17:55.069 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.069 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50266/0 (socket says 172.21.15.112:50266) 2020-11-20T11:17:55.070 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 -- 172.21.15.112:0/3994781355 learned_addr learned my addr 172.21.15.112:0/3994781355 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:55.070 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2abcfce700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ab8150550 0x7f2ab8060890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.070 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab7fff700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2ab8060290 0x7f2ab80bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.070 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 -- 172.21.15.112:0/3994781355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ab8150550 msgr2=0x7f2ab8060890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.070 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ab8150550 0x7f2ab8060890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.071 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 -- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2ab8060290 msgr2=0x7f2ab80bc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.071 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2ab8060290 0x7f2ab80bc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.071 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 -- 172.21.15.112:0/3994781355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80bd0d0 con 0x7f2ab80627f0 2020-11-20T11:17:55.071 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2ab77fe700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2aac00c790 tx=0x7f2aac007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.071 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac007320 con 0x7f2ab80627f0 2020-11-20T11:17:55.072 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac005570 con 0x7f2ab80627f0 2020-11-20T11:17:55.072 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab80bd370 con 0x7f2ab80627f0 2020-11-20T11:17:55.072 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0058f0 con 0x7f2ab80627f0 2020-11-20T11:17:55.072 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.059+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab80bde60 con 0x7f2ab80627f0 2020-11-20T11:17:55.072 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.060+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab80be110 con 0x7f2ab80627f0 2020-11-20T11:17:55.073 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.061+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2aac010030 con 0x7f2ab80627f0 2020-11-20T11:17:55.073 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.061+0000 7f2a97fff700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 0x7f2a90082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.073 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.061+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f2aac0a2180 con 0x7f2ab80627f0 2020-11-20T11:17:55.073 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.061+0000 7f2ab7fff700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 0x7f2a90082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.073 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.062+0000 7f2ab7fff700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 0x7f2a90082b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2aa8006f30 tx=0x7f2aa8016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.074 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.065+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2aac077210 con 0x7f2ab80627f0 2020-11-20T11:17:55.213 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.211+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ab80bd500 con 0x7f2ab80627f0 2020-11-20T11:17:55.214 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.211+0000 7f2a97fff700 1 -- 172.21.15.112:0/3994781355 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16905 (secure 0 0 0) 0x7f2aac07a830 con 0x7f2ab80627f0 2020-11-20T11:17:55.215 INFO:teuthology.misc.health.smithi112.stdout: 2020-11-20T11:17:55.215 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":20,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:17:52.568865+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:17:55.216 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 msgr2=0x7f2a90082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.216 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 0x7f2a90082b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2aa8006f30 tx=0x7f2aa8016000).stop 2020-11-20T11:17:55.216 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 msgr2=0x7f2ab80bd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.217 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2aac00c790 tx=0x7f2aac007b20).stop 2020-11-20T11:17:55.217 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 shutdown_connections 2020-11-20T11:17:55.218 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2a90080670 0x7f2a90082b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.218 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ab8150550 0x7f2ab8060890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.218 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2ab8060290 0x7f2ab80bc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.218 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 --2- 172.21.15.112:0/3994781355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab80627f0 0x7f2ab80bd970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.218 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 >> 172.21.15.112:0/3994781355 conn(0x7f2ab8067380 msgr2=0x7f2ab81509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:55.219 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 shutdown_connections 2020-11-20T11:17:55.219 INFO:teuthology.misc.health.smithi112.stderr:2020-11-20T11:17:55.213+0000 7f2abd7cf700 1 -- 172.21.15.112:0/3994781355 wait complete. 2020-11-20T11:17:55.226 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T11:17:55.226 INFO:tasks.ceph:Creating RBD pool 2020-11-20T11:17:55.227 INFO:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T11:17:55.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.331+0000 7f4ea13c3700 1 Processor -- start 2020-11-20T11:17:55.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.332+0000 7f4ea13c3700 1 -- start start 2020-11-20T11:17:55.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.332+0000 7f4ea13c3700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f4e9c061930 0x7f4e9c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.332+0000 7f4ea13c3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c1516b0 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.332+0000 7f4ea13c3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c1518e0 con 0x7f4e9c155700 2020-11-20T11:17:55.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.332+0000 7f4ea13c3700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c155b90 con 0x7f4e9c061930 2020-11-20T11:17:55.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4e9c0c5a10 0x7f4e9c061220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34466/0 (socket says 172.21.15.112:34466) 2020-11-20T11:17:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9affd700 1 -- 172.21.15.112:0/987681910 learned_addr learned my addr 172.21.15.112:0/987681910 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966171830 0 0) 0x7f4e9c1516b0 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e88003280 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/987681910 >> v2:172.21.15.166:3300/0 conn(0x7f4e9c061930 0x7f4e9c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1391541678 0 0) 0x7f4e88003280 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 >> v2:172.21.15.166:3300/0 conn(0x7f4e9c061930 msgr2=0x7f4e9c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 --2- 172.21.15.112:0/987681910 >> v2:172.21.15.166:3300/0 conn(0x7f4e9c061930 0x7f4e9c0c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 >> v1:172.21.15.166:6789/0 conn(0x7f4e9c155700 legacy=0x7f4e9c064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c151b80 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f4e8c001520 con 0x7f4e9c0c5a10 2020-11-20T11:17:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 >> v1:172.21.15.112:6789/0 conn(0x7f4e9c0c5a10 legacy=0x7f4e9c061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e880037c0 0x7f4e88003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 0x7f4e880049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004e90 0x7f4e8800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c155b90 con 0x7f4e88004520 2020-11-20T11:17:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88005370 con 0x7f4e880037c0 2020-11-20T11:17:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8800bc60 con 0x7f4e88004e90 2020-11-20T11:17:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 0x7f4e880049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9affd700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e880037c0 0x7f4e88003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/987681910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004e90 msgr2=0x7f4e8800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004e90 0x7f4e8800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:17:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/987681910 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e880037c0 msgr2=0x7f4e88003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e880037c0 0x7f4e88003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.333+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/987681910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88003280 con 0x7f4e88004520 2020-11-20T11:17:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4e9b7fe700 1 -- 172.21.15.112:0/987681910 reap_dead start 2020-11-20T11:17:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 0x7f4e880049a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4e90006fd0 tx=0x7f4e90006e30).ready entity=mon.0 client_cookie=470ff890b6d11ac2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90016070 con 0x7f4e88004520 2020-11-20T11:17:55.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000b370 con 0x7f4e88004520 2020-11-20T11:17:55.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4e99ffb700 1 -- 172.21.15.112:0/987681910 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000ebe0 con 0x7f4e88004520 2020-11-20T11:17:55.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 -- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 msgr2=0x7f4e880049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 0x7f4e880049a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4e90006fd0 tx=0x7f4e90006e30).stop 2020-11-20T11:17:55.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 -- 172.21.15.112:0/987681910 shutdown_connections 2020-11-20T11:17:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/987681910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e88004520 0x7f4e880049a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 -- 172.21.15.112:0/987681910 >> 172.21.15.112:0/987681910 conn(0x7f4e9c0bbc50 msgr2=0x7f4e9c0bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 -- 172.21.15.112:0/987681910 shutdown_connections 2020-11-20T11:17:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.334+0000 7f4ea13c3700 1 -- 172.21.15.112:0/987681910 wait complete. 2020-11-20T11:17:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.335+0000 7f4ea13c3700 1 Processor -- start 2020-11-20T11:17:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 -- start start 2020-11-20T11:17:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004520 0x7f4e9c164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 0x7f4e9c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c14cc40 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c160ce0 con 0x7f4e9c064d60 2020-11-20T11:17:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4ea13c3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c160f80 con 0x7f4e88004520 2020-11-20T11:17:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4e9a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4e9a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50284/0 (socket says 172.21.15.112:50284) 2020-11-20T11:17:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.336+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/1165049731 learned_addr learned my addr 172.21.15.112:0/1165049731 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9b7fe700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 0x7f4e9c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9affd700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004520 0x7f4e9c164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/1165049731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004520 msgr2=0x7f4e9c164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004520 0x7f4e9c164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 msgr2=0x7f4e9c142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 0x7f4e9c142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 -- 172.21.15.112:0/1165049731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c161220 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9b7fe700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 0x7f4e9c142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:17:55.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e9a7fc700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4e9000f010 tx=0x7f4e90018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012dc0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90000e90 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c1614c0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9001d430 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.337+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c161a00 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.338+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c1650a0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.338+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4e9001c410 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.339+0000 7f4e82ffd700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 0x7f4e78082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.339+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f4e900a3c10 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.339+0000 7f4e9affd700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 0x7f4e78082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.340+0000 7f4e9affd700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 0x7f4e78082b60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4e8c007c00 tx=0x7f4e8c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.342+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4e9c1650a0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.482+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4e9c1650a0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.583+0000 7f4e82ffd700 1 -- 172.21.15.112:0/1165049731 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v21) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4e9c1650a0 con 0x7f4e9c0bcb50 2020-11-20T11:17:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 msgr2=0x7f4e78082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 0x7f4e78082b60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4e8c007c00 tx=0x7f4e8c009040).stop 2020-11-20T11:17:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 msgr2=0x7f4e9c064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4e9000f010 tx=0x7f4e90018000).stop 2020-11-20T11:17:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 shutdown_connections 2020-11-20T11:17:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4e780806a0 0x7f4e78082b60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4e9c064d60 0x7f4e9c142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e88004520 0x7f4e9c164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 --2- 172.21.15.112:0/1165049731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e9c0bcb50 0x7f4e9c064870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 >> 172.21.15.112:0/1165049731 conn(0x7f4e9c0bbc50 msgr2=0x7f4e9c061220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 shutdown_connections 2020-11-20T11:17:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.585+0000 7f4ea13c3700 1 -- 172.21.15.112:0/1165049731 wait complete. 2020-11-20T11:17:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2020-11-20T11:17:55.601 INFO:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T11:17:55.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.707+0000 7fa719e8f700 1 Processor -- start 2020-11-20T11:17:55.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.707+0000 7fa719e8f700 1 -- start start 2020-11-20T11:17:55.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa719e8f700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa7140c7df0 0x7fa7140601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa719e8f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa714060790 con 0x7fa7140c7a10 2020-11-20T11:17:55.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa719e8f700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa714060a30 con 0x7fa7140c4810 2020-11-20T11:17:55.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa719e8f700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140c4150 con 0x7fa7140c7df0 2020-11-20T11:17:55.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa718e8d700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7fa7140c7a10 0x7fa7140bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45138/0 (socket says 172.21.15.112:45138) 2020-11-20T11:17:55.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa718e8d700 1 -- 172.21.15.112:0/2770393999 learned_addr learned my addr 172.21.15.112:0/2770393999 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:55.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa713fff700 1 --2- 172.21.15.112:0/2770393999 >> v2:172.21.15.204:3300/0 conn(0x7fa7140c7df0 0x7fa7140601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa7137fe700 1 -- 172.21.15.112:0/2770393999 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167229090 0 0) 0x7fa714060790 con 0x7fa7140c7a10 2020-11-20T11:17:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa7137fe700 1 -- 172.21.15.112:0/2770393999 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003280 con 0x7fa7140c7a10 2020-11-20T11:17:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa713fff700 1 -- 172.21.15.112:0/2770393999 >> v1:172.21.15.204:6789/0 conn(0x7fa7140c4810 legacy=0x7fa7140c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.708+0000 7fa713fff700 1 -- 172.21.15.112:0/2770393999 >> v1:172.21.15.166:6789/0 conn(0x7fa7140c7a10 legacy=0x7fa7140bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa713fff700 1 -- 172.21.15.112:0/2770393999 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714060cd0 con 0x7fa7140c7df0 2020-11-20T11:17:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa713fff700 1 --2- 172.21.15.112:0/2770393999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7df0 0x7fa7140601b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa700006fd0 tx=0x7fa700006e30).ready entity=mon.2 client_cookie=541a2f05b5a3069a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa7137fe700 1 -- 172.21.15.112:0/2770393999 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000097e0 con 0x7fa7140c7df0 2020-11-20T11:17:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa7137fe700 1 -- 172.21.15.112:0/2770393999 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700000e90 con 0x7fa7140c7df0 2020-11-20T11:17:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa7137fe700 1 -- 172.21.15.112:0/2770393999 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700009b50 con 0x7fa7140c7df0 2020-11-20T11:17:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 -- 172.21.15.112:0/2770393999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7df0 msgr2=0x7fa7140601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 --2- 172.21.15.112:0/2770393999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7df0 0x7fa7140601b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa700006fd0 tx=0x7fa700006e30).stop 2020-11-20T11:17:55.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 -- 172.21.15.112:0/2770393999 shutdown_connections 2020-11-20T11:17:55.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 --2- 172.21.15.112:0/2770393999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7df0 0x7fa7140601b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 -- 172.21.15.112:0/2770393999 >> 172.21.15.112:0/2770393999 conn(0x7fa71405bac0 msgr2=0x7fa714062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:55.717 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 -- 172.21.15.112:0/2770393999 shutdown_connections 2020-11-20T11:17:55.717 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.709+0000 7fa719e8f700 1 -- 172.21.15.112:0/2770393999 wait complete. 2020-11-20T11:17:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.710+0000 7fa719e8f700 1 Processor -- start 2020-11-20T11:17:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 -- start start 2020-11-20T11:17:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa7140c4810 0x7fa714163b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7a10 0x7fa71414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714164050 con 0x7fa7140c7df0 2020-11-20T11:17:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141642d0 con 0x7fa7140c4810 2020-11-20T11:17:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa719e8f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714164570 con 0x7fa7140c7a10 2020-11-20T11:17:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa71968e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa71968e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50298/0 (socket says 172.21.15.112:50298) 2020-11-20T11:17:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa71968e700 1 -- 172.21.15.112:0/1138257149 learned_addr learned my addr 172.21.15.112:0/1138257149 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.711+0000 7fa718e8d700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa7140c4810 0x7fa714163b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa713fff700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7a10 0x7fa71414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 -- 172.21.15.112:0/1138257149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7a10 msgr2=0x7fa71414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7a10 0x7fa71414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 -- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa7140c4810 msgr2=0x7fa714163b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa7140c4810 0x7fa714163b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 -- 172.21.15.112:0/1138257149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714164810 con 0x7fa7140c7df0 2020-11-20T11:17:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa71968e700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa70c00ca90 tx=0x7fa70c0014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00ce70 con 0x7fa7140c7df0 2020-11-20T11:17:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00a760 con 0x7fa7140c7df0 2020-11-20T11:17:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71414cc20 con 0x7fa7140c7df0 2020-11-20T11:17:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00aae0 con 0x7fa7140c7df0 2020-11-20T11:17:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.712+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71414ec60 con 0x7fa7140c7df0 2020-11-20T11:17:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.713+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71414ca70 con 0x7fa7140c7df0 2020-11-20T11:17:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.714+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa70c010070 con 0x7fa7140c7df0 2020-11-20T11:17:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.714+0000 7fa710ff9700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 0x7fa6ec082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.714+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fa70c0a2c90 con 0x7fa7140c7df0 2020-11-20T11:17:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.714+0000 7fa718e8d700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 0x7fa6ec082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.715+0000 7fa718e8d700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 0x7fa6ec082b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa7140bf730 tx=0x7fa708009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:55.726 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.717+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa70c077bd0 con 0x7fa7140c7df0 2020-11-20T11:17:55.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:55.857+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa7140008d0 con 0x7fa7140c7df0 2020-11-20T11:17:56.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.588+0000 7fa710ff9700 1 -- 172.21.15.112:0/1138257149 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v22) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa70c07b1f0 con 0x7fa7140c7df0 2020-11-20T11:17:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.590+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 msgr2=0x7fa6ec082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.590+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 0x7fa6ec082b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa7140bf730 tx=0x7fa708009040).stop 2020-11-20T11:17:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.590+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 msgr2=0x7fa71414d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.590+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa70c00ca90 tx=0x7fa70c0014a0).stop 2020-11-20T11:17:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 shutdown_connections 2020-11-20T11:17:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fa6ec080670 0x7fa6ec082b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7140c7df0 0x7fa71414d360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa7140c4810 0x7fa714163b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 --2- 172.21.15.112:0/1138257149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa7140c7a10 0x7fa71414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 >> 172.21.15.112:0/1138257149 conn(0x7fa71405bac0 msgr2=0x7fa7140c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 shutdown_connections 2020-11-20T11:17:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.591+0000 7fa719e8f700 1 -- 172.21.15.112:0/1138257149 wait complete. 2020-11-20T11:17:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T11:17:56.607 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T11:17:56.608 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T11:17:56.608 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T11:17:56.611 INFO:tasks.ceph.mds.a:Started 2020-11-20T11:17:56.611 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T11:17:56.611 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T11:17:56.614 INFO:tasks.ceph.mds.b:Started 2020-11-20T11:17:56.614 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T11:17:56.615 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T11:17:56.617 INFO:tasks.ceph.mds.c:Started 2020-11-20T11:17:56.618 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T11:17:56.618 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:17:56.688 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2020-11-20T11:17:56.694 INFO:tasks.ceph.mds.b.smithi166.stdout:starting mds.b at 2020-11-20T11:17:56.699 INFO:tasks.ceph.mds.c.smithi204.stdout:starting mds.c at 2020-11-20T11:17:56.741 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.738+0000 7f01d2c52700 1 Processor -- start 2020-11-20T11:17:56.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.739+0000 7f01d2c52700 1 -- start start 2020-11-20T11:17:56.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.739+0000 7f01d2c52700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f01cc14ea20 0x7f01cc0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.739+0000 7f01d2c52700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc14eeb0 con 0x7f01cc064a10 2020-11-20T11:17:56.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.739+0000 7f01d2c52700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc0c4b60 con 0x7f01cc064df0 2020-11-20T11:17:56.748 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d2c52700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0c02b0 con 0x7f01cc14ea20 2020-11-20T11:17:56.748 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d1c50700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f01cc064a10 0x7f01cc0bfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34512/0 (socket says 172.21.15.112:34512) 2020-11-20T11:17:56.748 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d1c50700 1 -- 172.21.15.112:0/3670581007 learned_addr learned my addr 172.21.15.112:0/3670581007 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:56.748 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188069641 0 0) 0x7f01cc14eeb0 con 0x7f01cc064a10 2020-11-20T11:17:56.748 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b4003280 con 0x7f01cc064a10 2020-11-20T11:17:56.749 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d2451700 1 --2- 172.21.15.112:0/3670581007 >> v2:172.21.15.204:3300/0 conn(0x7f01cc14ea20 0x7f01cc0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.749 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290307652 0 0) 0x7f01cc0c4b60 con 0x7f01cc064df0 2020-11-20T11:17:56.749 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc14eeb0 con 0x7f01cc064df0 2020-11-20T11:17:56.749 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1172381538 0 0) 0x7f01b4003280 con 0x7f01cc064a10 2020-11-20T11:17:56.750 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 >> v2:172.21.15.204:3300/0 conn(0x7f01cc14ea20 msgr2=0x7f01cc0c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:56.750 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 --2- 172.21.15.112:0/3670581007 >> v2:172.21.15.204:3300/0 conn(0x7f01cc14ea20 0x7f01cc0c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.750 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 >> v1:172.21.15.166:6789/0 conn(0x7f01cc064df0 legacy=0x7f01cc14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.750 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc154bc0 con 0x7f01cc064a10 2020-11-20T11:17:56.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f01c8001520 con 0x7f01cc064a10 2020-11-20T11:17:56.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 >> v1:172.21.15.112:6789/0 conn(0x7f01cc064a10 legacy=0x7f01cc0bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4003950 0x7f01b4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 0x7f01b40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b4004e90 0x7f01b400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0c02b0 con 0x7f01b4004520 2020-11-20T11:17:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b400bc60 con 0x7f01b4004e90 2020-11-20T11:17:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b400bdd0 con 0x7f01b4003950 2020-11-20T11:17:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d144f700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 0x7f01b40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d2451700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b4004e90 0x7f01b400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.740+0000 7f01d1c50700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4003950 0x7f01b4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 -- 172.21.15.112:0/3670581007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4003950 msgr2=0x7f01b4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:56.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4003950 0x7f01b4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 -- 172.21.15.112:0/3670581007 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b4004e90 msgr2=0x7f01b400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:56.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b4004e90 0x7f01b400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 -- 172.21.15.112:0/3670581007 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4003280 con 0x7f01b4004520 2020-11-20T11:17:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2451700 1 -- 172.21.15.112:0/3670581007 reap_dead start 2020-11-20T11:17:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d144f700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 0x7f01b40049a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f01bc001ac0 tx=0x7f01bc007bd0).ready entity=mon.0 client_cookie=a80a90e57b360c66 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc007020 con 0x7f01b4004520 2020-11-20T11:17:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc007180 con 0x7f01b4004520 2020-11-20T11:17:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d0c4e700 1 -- 172.21.15.112:0/3670581007 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00c610 con 0x7f01b4004520 2020-11-20T11:17:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 -- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 msgr2=0x7f01b40049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 0x7f01b40049a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f01bc001ac0 tx=0x7f01bc007bd0).stop 2020-11-20T11:17:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 -- 172.21.15.112:0/3670581007 shutdown_connections 2020-11-20T11:17:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 --2- 172.21.15.112:0/3670581007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01b4004520 0x7f01b40049a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 -- 172.21.15.112:0/3670581007 >> 172.21.15.112:0/3670581007 conn(0x7f01cc060820 msgr2=0x7f01cc05bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 -- 172.21.15.112:0/3670581007 shutdown_connections 2020-11-20T11:17:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.741+0000 7f01d2c52700 1 -- 172.21.15.112:0/3670581007 wait complete. 2020-11-20T11:17:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.742+0000 7f01d2c52700 1 Processor -- start 2020-11-20T11:17:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 -- start start 2020-11-20T11:17:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4004520 0x7f01cc0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01cc1644c0 0x7f01cc0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc163ba0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc157ba0 con 0x7f01cc1644c0 2020-11-20T11:17:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2c52700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc157e40 con 0x7f01b4004520 2020-11-20T11:17:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d144f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d144f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50334/0 (socket says 172.21.15.112:50334) 2020-11-20T11:17:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d144f700 1 -- 172.21.15.112:0/746292149 learned_addr learned my addr 172.21.15.112:0/746292149 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d2451700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01cc1644c0 0x7f01cc0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.743+0000 7f01d1c50700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4004520 0x7f01cc0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 -- 172.21.15.112:0/746292149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4004520 msgr2=0x7f01cc0c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4004520 0x7f01cc0c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 -- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01cc1644c0 msgr2=0x7f01cc0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01cc1644c0 0x7f01cc0c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 -- 172.21.15.112:0/746292149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc1580e0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d144f700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f01b4005500 tx=0x7f01bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012810 con 0x7f01cc0c2e20 2020-11-20T11:17:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc012970 con 0x7f01cc0c2e20 2020-11-20T11:17:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012d10 con 0x7f01cc0c2e20 2020-11-20T11:17:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc158380 con 0x7f01cc0c2e20 2020-11-20T11:17:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.744+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc1588c0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.762 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.745+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc0008d0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.746+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f01bc024030 con 0x7f01cc0c2e20 2020-11-20T11:17:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.746+0000 7f01b9ffb700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 0x7f01a4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.746+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f01bc0a35d0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.746+0000 7f01d1c50700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 0x7f01a4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.747+0000 7f01d1c50700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 0x7f01a4082b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f01cc0c5f60 tx=0x7f01c8007790).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.750+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f01bc04efd0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.894 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.891+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01cc163ce0 con 0x7f01cc0c2e20 2020-11-20T11:17:56.895 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.892+0000 7f01b9ffb700 1 -- 172.21.15.112:0/746292149 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18438 (secure 0 0 0) 0x7f01bc022020 con 0x7f01cc0c2e20 2020-11-20T11:17:56.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:17:56.896 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:17:56.583030+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:17:56.898 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 msgr2=0x7f01a4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.898 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 0x7f01a4082b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f01cc0c5f60 tx=0x7f01c8007790).stop 2020-11-20T11:17:56.898 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 msgr2=0x7f01cc163fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f01b4005500 tx=0x7f01bc016000).stop 2020-11-20T11:17:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 shutdown_connections 2020-11-20T11:17:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f01a4080670 0x7f01a4082b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01cc1644c0 0x7f01cc0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01b4004520 0x7f01cc0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 --2- 172.21.15.112:0/746292149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01cc0c2e20 0x7f01cc163fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 >> 172.21.15.112:0/746292149 conn(0x7f01cc060820 msgr2=0x7f01cc0c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 shutdown_connections 2020-11-20T11:17:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:56.893+0000 7f01d2c52700 1 -- 172.21.15.112:0/746292149 wait complete. 2020-11-20T11:17:56.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:17:46.086314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:17:55.502772+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T11:17:56.908 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:17:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.016+0000 7f6c5e668700 1 Processor -- start 2020-11-20T11:17:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.016+0000 7f6c5e668700 1 -- start start 2020-11-20T11:17:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c5e668700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6c58065d30 0x7f6c58066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c5e668700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580c5230 con 0x7f6c580bfa50 2020-11-20T11:17:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c5e668700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c581549c0 con 0x7f6c581512e0 2020-11-20T11:17:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c5e668700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c58154c60 con 0x7f6c58065d30 2020-11-20T11:17:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c577fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6c580bfa50 0x7f6c580c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34534/0 (socket says 172.21.15.112:34534) 2020-11-20T11:17:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.017+0000 7f6c577fe700 1 -- 172.21.15.112:0/3521072086 learned_addr learned my addr 172.21.15.112:0/3521072086 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305792933 0 0) 0x7f6c580c5230 con 0x7f6c580bfa50 2020-11-20T11:17:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3521072086 >> v2:172.21.15.204:3300/0 conn(0x7f6c58065d30 0x7f6c58066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c44003280 con 0x7f6c580bfa50 2020-11-20T11:17:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3322436367 0 0) 0x7f6c44003280 con 0x7f6c580bfa50 2020-11-20T11:17:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 >> v2:172.21.15.204:3300/0 conn(0x7f6c58065d30 msgr2=0x7f6c58066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/3521072086 >> v2:172.21.15.204:3300/0 conn(0x7f6c58065d30 0x7f6c58066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 >> v1:172.21.15.204:6789/0 conn(0x7f6c581512e0 legacy=0x7f6c58151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c58154f00 con 0x7f6c580bfa50 2020-11-20T11:17:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f6c4c001520 con 0x7f6c580bfa50 2020-11-20T11:17:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 >> v1:172.21.15.112:6789/0 conn(0x7f6c580bfa50 legacy=0x7f6c580c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 0x7f6c44003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44004520 0x7f6c440049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c44004e90 0x7f6c4400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.027 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58154c60 con 0x7f6c44003810 2020-11-20T11:17:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4400bc60 con 0x7f6c44004520 2020-11-20T11:17:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4400bda0 con 0x7f6c44004e90 2020-11-20T11:17:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 0x7f6c44003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c5cc05700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c44004e90 0x7f6c4400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 -- 172.21.15.112:0/3521072086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c44004e90 msgr2=0x7f6c4400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c44004e90 0x7f6c4400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 -- 172.21.15.112:0/3521072086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44004520 msgr2=0x7f6c440049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44004520 0x7f6c440049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:17:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 -- 172.21.15.112:0/3521072086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44003280 con 0x7f6c44003810 2020-11-20T11:17:57.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c5cc05700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c44004e90 0x7f6c4400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:17:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c5cc05700 1 -- 172.21.15.112:0/3521072086 reap_dead start 2020-11-20T11:17:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.018+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 0x7f6c44003c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6c4800bc40 tx=0x7f6c48006e30).ready entity=mon.0 client_cookie=ab7a39db1cf28763 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800b350 con 0x7f6c44003810 2020-11-20T11:17:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800eab0 con 0x7f6c44003810 2020-11-20T11:17:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c56ffd700 1 -- 172.21.15.112:0/3521072086 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800ee30 con 0x7f6c44003810 2020-11-20T11:17:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 -- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 msgr2=0x7f6c44003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 0x7f6c44003c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6c4800bc40 tx=0x7f6c48006e30).stop 2020-11-20T11:17:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 -- 172.21.15.112:0/3521072086 shutdown_connections 2020-11-20T11:17:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3521072086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c44003810 0x7f6c44003c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.031 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 -- 172.21.15.112:0/3521072086 >> 172.21.15.112:0/3521072086 conn(0x7f6c5805bac0 msgr2=0x7f6c5805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 -- 172.21.15.112:0/3521072086 shutdown_connections 2020-11-20T11:17:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.019+0000 7f6c5e668700 1 -- 172.21.15.112:0/3521072086 wait complete. 2020-11-20T11:17:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.020+0000 7f6c5e668700 1 Processor -- start 2020-11-20T11:17:57.032 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.020+0000 7f6c5e668700 1 -- start start 2020-11-20T11:17:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 0x7f6c580c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c580c73b0 0x7f6c58152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5814deb0 con 0x7f6c580c2e20 2020-11-20T11:17:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581618f0 con 0x7f6c44003810 2020-11-20T11:17:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5e668700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5814cf90 con 0x7f6c580c73b0 2020-11-20T11:17:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50352/0 (socket says 172.21.15.112:50352) 2020-11-20T11:17:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 -- 172.21.15.112:0/3655681185 learned_addr learned my addr 172.21.15.112:0/3655681185 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c5cc05700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c580c73b0 0x7f6c58152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 0x7f6c580c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 -- 172.21.15.112:0/3655681185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c580c73b0 msgr2=0x7f6c58152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c580c73b0 0x7f6c58152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 -- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 msgr2=0x7f6c580c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 0x7f6c580c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c577fe700 1 -- 172.21.15.112:0/3655681185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5814d230 con 0x7f6c580c2e20 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.021+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 0x7f6c580c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c577fe700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6c4c00ca90 tx=0x7f6c58155090).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c007170 con 0x7f6c580c2e20 2020-11-20T11:17:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0072d0 con 0x7f6c580c2e20 2020-11-20T11:17:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5814d4d0 con 0x7f6c580c2e20 2020-11-20T11:17:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00a990 con 0x7f6c580c2e20 2020-11-20T11:17:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.022+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5814da10 con 0x7f6c580c2e20 2020-11-20T11:17:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.023+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580666e0 con 0x7f6c580c2e20 2020-11-20T11:17:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.023+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6c4c010070 con 0x7f6c580c2e20 2020-11-20T11:17:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.024+0000 7f6c37fff700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 0x7f6c30082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.024+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f6c4c0a1ff0 con 0x7f6c580c2e20 2020-11-20T11:17:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.024+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 0x7f6c30082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.024+0000 7f6c57fff700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 0x7f6c30082b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6c48006e70 tx=0x7f6c48019000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.027+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6c4c076f20 con 0x7f6c580c2e20 2020-11-20T11:17:57.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.167+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6c58151f70 con 0x7f6c580c2e20 2020-11-20T11:17:57.170 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.167+0000 7f6c37fff700 1 -- 172.21.15.112:0/3655681185 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6c4c07a540 con 0x7f6c580c2e20 2020-11-20T11:17:57.170 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2020-11-20T11:17:57.171 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 msgr2=0x7f6c30082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.171 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 0x7f6c30082b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6c48006e70 tx=0x7f6c48019000).stop 2020-11-20T11:17:57.172 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 msgr2=0x7f6c581527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.172 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6c4c00ca90 tx=0x7f6c58155090).stop 2020-11-20T11:17:57.172 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 shutdown_connections 2020-11-20T11:17:57.172 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6c300806a0 0x7f6c30082b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.172 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c580c73b0 0x7f6c58152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.173 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6c44003810 0x7f6c580c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.173 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 --2- 172.21.15.112:0/3655681185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580c2e20 0x7f6c581527d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.173 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 >> 172.21.15.112:0/3655681185 conn(0x7f6c5805bac0 msgr2=0x7f6c5814e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.173 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 shutdown_connections 2020-11-20T11:17:57.174 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.168+0000 7f6c5e668700 1 -- 172.21.15.112:0/3655681185 wait complete. 2020-11-20T11:17:57.182 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:17:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.290+0000 7f012568f700 1 Processor -- start 2020-11-20T11:17:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.290+0000 7f012568f700 1 -- start start 2020-11-20T11:17:57.295 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.291+0000 7f012568f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f01200c5a10 0x7f01200c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.291+0000 7f012568f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01201516b0 con 0x7f0120155700 2020-11-20T11:17:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.291+0000 7f012568f700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0120155b60 con 0x7f0120061930 2020-11-20T11:17:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.291+0000 7f012568f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01201518e0 con 0x7f01200c5a10 2020-11-20T11:17:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.291+0000 7f011effd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f01200c5a10 0x7f01200c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.297 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011f7fe700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f0120061930 0x7f0120064720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:44682/0 (socket says 172.21.15.112:44682) 2020-11-20T11:17:57.297 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011f7fe700 1 -- 172.21.15.112:0/883507261 learned_addr learned my addr 172.21.15.112:0/883507261 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:57.297 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410071718 0 0) 0x7f0118001490 con 0x7f0120061930 2020-11-20T11:17:57.297 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0100003280 con 0x7f0120061930 2020-11-20T11:17:57.297 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506828363 0 0) 0x7f01201516b0 con 0x7f0120155700 2020-11-20T11:17:57.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011effd700 1 -- 172.21.15.112:0/883507261 >> v1:172.21.15.204:6789/0 conn(0x7f0120061930 legacy=0x7f0120064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011effd700 1 -- 172.21.15.112:0/883507261 >> v1:172.21.15.166:6789/0 conn(0x7f0120155700 legacy=0x7f0120061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011effd700 1 -- 172.21.15.112:0/883507261 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120151b80 con 0x7f01200c5a10 2020-11-20T11:17:57.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011effd700 1 --2- 172.21.15.112:0/883507261 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f01200c5df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0110006fd0 tx=0x7f0110006e30).ready entity=mon.1 client_cookie=1b87f250864b9aa9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000bec0 con 0x7f01200c5a10 2020-11-20T11:17:57.299 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110000e90 con 0x7f01200c5a10 2020-11-20T11:17:57.299 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.292+0000 7f011e7fc700 1 -- 172.21.15.112:0/883507261 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100099f0 con 0x7f01200c5a10 2020-11-20T11:17:57.299 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 -- 172.21.15.112:0/883507261 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 msgr2=0x7f01200c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.299 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 --2- 172.21.15.112:0/883507261 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f01200c5df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0110006fd0 tx=0x7f0110006e30).stop 2020-11-20T11:17:57.299 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 -- 172.21.15.112:0/883507261 shutdown_connections 2020-11-20T11:17:57.300 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 --2- 172.21.15.112:0/883507261 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f01200c5df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.300 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 -- 172.21.15.112:0/883507261 >> 172.21.15.112:0/883507261 conn(0x7f01200bbc50 msgr2=0x7f01200bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.300 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 -- 172.21.15.112:0/883507261 shutdown_connections 2020-11-20T11:17:57.300 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.293+0000 7f012568f700 1 -- 172.21.15.112:0/883507261 wait complete. 2020-11-20T11:17:57.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 Processor -- start 2020-11-20T11:17:57.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 -- start start 2020-11-20T11:17:57.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f0120064e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.304 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0120155700 0x7f01200becf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.304 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.294+0000 7f012568f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0120160b60 con 0x7f0120061930 2020-11-20T11:17:57.304 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f012568f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0120160e00 con 0x7f01200c5a10 2020-11-20T11:17:57.304 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f012568f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01201610a0 con 0x7f0120155700 2020-11-20T11:17:57.304 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50366/0 (socket says 172.21.15.112:50366) 2020-11-20T11:17:57.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 -- 172.21.15.112:0/3885030751 learned_addr learned my addr 172.21.15.112:0/3885030751 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f0117fff700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f0120064e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011f7fe700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0120155700 0x7f01200becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 -- 172.21.15.112:0/3885030751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0120155700 msgr2=0x7f01200becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0120155700 0x7f01200becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 -- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 msgr2=0x7f0120064e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f0120064e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 -- 172.21.15.112:0/3885030751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120161340 con 0x7f0120061930 2020-11-20T11:17:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f011effd700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0120062c50 tx=0x7f0110015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110011b40 con 0x7f0120061930 2020-11-20T11:17:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110011ca0 con 0x7f0120061930 2020-11-20T11:17:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01201615e0 con 0x7f0120061930 2020-11-20T11:17:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011001e690 con 0x7f0120061930 2020-11-20T11:17:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.295+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0120065380 con 0x7f0120061930 2020-11-20T11:17:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.296+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0120065600 con 0x7f0120061930 2020-11-20T11:17:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.297+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0110025030 con 0x7f0120061930 2020-11-20T11:17:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.297+0000 7f0116ffd700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 0x7f00fc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.297+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f01100a39d0 con 0x7f0120061930 2020-11-20T11:17:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.298+0000 7f0117fff700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 0x7f00fc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.298+0000 7f0117fff700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 0x7f00fc082b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0108007fd0 tx=0x7f0108007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.301+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f01100787f0 con 0x7f0120061930 2020-11-20T11:17:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.441+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f01200666e0 con 0x7f0120061930 2020-11-20T11:17:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.441+0000 7f0116ffd700 1 -- 172.21.15.112:0/3885030751 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0110023020 con 0x7f0120061930 2020-11-20T11:17:57.444 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:17:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 msgr2=0x7f00fc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 0x7f00fc082b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0108007fd0 tx=0x7f0108007bd0).stop 2020-11-20T11:17:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 msgr2=0x7f0120164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0120062c50 tx=0x7f0110015000).stop 2020-11-20T11:17:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 shutdown_connections 2020-11-20T11:17:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00fc080670 0x7f00fc082b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0120155700 0x7f01200becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0120061930 0x7f0120164910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.442+0000 7f012568f700 1 --2- 172.21.15.112:0/3885030751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01200c5a10 0x7f0120064e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.443+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 >> 172.21.15.112:0/3885030751 conn(0x7f01200bbc50 msgr2=0x7f01200bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.443+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 shutdown_connections 2020-11-20T11:17:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.443+0000 7f012568f700 1 -- 172.21.15.112:0/3885030751 wait complete. 2020-11-20T11:17:57.456 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T11:17:57.565 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.562+0000 7ff8f5889700 1 Processor -- start 2020-11-20T11:17:57.565 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.562+0000 7ff8f5889700 1 -- start start 2020-11-20T11:17:57.567 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8f5889700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8f0066110 0x7ff8f00bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.567 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8f5889700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00c5230 con 0x7ff8f01512e0 2020-11-20T11:17:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8f5889700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f01549c0 con 0x7ff8f0065d30 2020-11-20T11:17:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8f5889700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f00bff40 con 0x7ff8f0066110 2020-11-20T11:17:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8ee7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8f0066110 0x7ff8f00bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8ee7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8f0066110 0x7ff8f00bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50376/0 (socket says 172.21.15.112:50376) 2020-11-20T11:17:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/3898307988 learned_addr learned my addr 172.21.15.112:0/3898307988 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.563+0000 7ff8ef7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff8f01512e0 0x7ff8f0151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34568/0 (socket says 172.21.15.112:34568) 2020-11-20T11:17:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/3898307988 >> v1:172.21.15.166:6789/0 conn(0x7ff8f0065d30 legacy=0x7ff8f00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/3898307988 >> v1:172.21.15.112:6789/0 conn(0x7ff8f01512e0 legacy=0x7ff8f0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/3898307988 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0154c60 con 0x7ff8f0066110 2020-11-20T11:17:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8edffb700 1 -- 172.21.15.112:0/3898307988 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910716808 0 0) 0x7ff8f00c5230 con 0x7ff8f01512e0 2020-11-20T11:17:57.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8ee7fc700 1 --2- 172.21.15.112:0/3898307988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00bfa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff8e4009a10 tx=0x7ff8e4006ef0).ready entity=mon.0 client_cookie=4ba1a87c15f37c05 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8edffb700 1 -- 172.21.15.112:0/3898307988 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400b820 con 0x7ff8f0066110 2020-11-20T11:17:57.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8edffb700 1 -- 172.21.15.112:0/3898307988 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4000e90 con 0x7ff8f0066110 2020-11-20T11:17:57.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8edffb700 1 -- 172.21.15.112:0/3898307988 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400bb90 con 0x7ff8f0066110 2020-11-20T11:17:57.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 -- 172.21.15.112:0/3898307988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 msgr2=0x7ff8f00bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 --2- 172.21.15.112:0/3898307988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00bfa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff8e4009a10 tx=0x7ff8e4006ef0).stop 2020-11-20T11:17:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 -- 172.21.15.112:0/3898307988 shutdown_connections 2020-11-20T11:17:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 --2- 172.21.15.112:0/3898307988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00bfa50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 -- 172.21.15.112:0/3898307988 >> 172.21.15.112:0/3898307988 conn(0x7ff8f005bac0 msgr2=0x7ff8f005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 -- 172.21.15.112:0/3898307988 shutdown_connections 2020-11-20T11:17:57.572 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.564+0000 7ff8f5889700 1 -- 172.21.15.112:0/3898307988 wait complete. 2020-11-20T11:17:57.574 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 Processor -- start 2020-11-20T11:17:57.574 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 -- start start 2020-11-20T11:17:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 0x7ff8f00c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 0x7ff8f00b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f014e010 con 0x7ff8f0066110 2020-11-20T11:17:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0164010 con 0x7ff8f0065d30 2020-11-20T11:17:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8f5889700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f014d590 con 0x7ff8f01512e0 2020-11-20T11:17:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8ee7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8ee7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50380/0 (socket says 172.21.15.112:50380) 2020-11-20T11:17:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.566+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/2621965568 learned_addr learned my addr 172.21.15.112:0/2621965568 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8eeffd700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 0x7ff8f00c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ef7fe700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 0x7ff8f00b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/2621965568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 msgr2=0x7ff8f00b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 0x7ff8f00b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 msgr2=0x7ff8f00c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 0x7ff8f00c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 -- 172.21.15.112:0/2621965568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f014d830 con 0x7ff8f0066110 2020-11-20T11:17:57.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ef7fe700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 0x7ff8f00b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:17:57.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8eeffd700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 0x7ff8f00c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:17:57.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8ee7fc700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff8f00c01a0 tx=0x7ff8e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4011db0 con 0x7ff8f0066110 2020-11-20T11:17:57.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e401c440 con 0x7ff8f0066110 2020-11-20T11:17:57.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e401c7e0 con 0x7ff8f0066110 2020-11-20T11:17:57.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f014dad0 con 0x7ff8f0066110 2020-11-20T11:17:57.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.567+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f0160960 con 0x7ff8f0066110 2020-11-20T11:17:57.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.568+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f00c1bf0 con 0x7ff8f0066110 2020-11-20T11:17:57.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.569+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff8e402c070 con 0x7ff8f0066110 2020-11-20T11:17:57.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.569+0000 7ff8d6ffd700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 0x7ff8cc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.569+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff8e40a4240 con 0x7ff8f0066110 2020-11-20T11:17:57.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.570+0000 7ff8eeffd700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 0x7ff8cc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.570+0000 7ff8eeffd700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 0x7ff8cc082b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff8e000b740 tx=0x7ff8e0008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.573+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff8e4079170 con 0x7ff8f0066110 2020-11-20T11:17:57.718 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.715+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff8f0065740 con 0x7ff8f0066110 2020-11-20T11:17:57.718 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.715+0000 7ff8d6ffd700 1 -- 172.21.15.112:0/2621965568 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v23) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff8e402a0a0 con 0x7ff8f0066110 2020-11-20T11:17:57.718 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:17:57.719 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2020-11-20T11:17:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2020-11-20T11:17:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2020-11-20T11:17:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "device_health_metrics" 2020-11-20T11:17:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2020-11-20T11:17:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2020-11-20T11:17:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2020-11-20T11:17:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2020-11-20T11:17:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2020-11-20T11:17:57.720 INFO:teuthology.orchestra.run.smithi112.stdout:] 2020-11-20T11:17:57.721 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 msgr2=0x7ff8cc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 0x7ff8cc082b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff8e000b740 tx=0x7ff8e0008040).stop 2020-11-20T11:17:57.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 msgr2=0x7ff8f00b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff8f00c01a0 tx=0x7ff8e4016000).stop 2020-11-20T11:17:57.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 shutdown_connections 2020-11-20T11:17:57.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8cc080670 0x7ff8cc082b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8f01512e0 0x7ff8f00b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff8f0065d30 0x7ff8f00c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.723 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 --2- 172.21.15.112:0/2621965568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f0066110 0x7ff8f00b1760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 >> 172.21.15.112:0/2621965568 conn(0x7ff8f005bac0 msgr2=0x7ff8f0151710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 shutdown_connections 2020-11-20T11:17:57.724 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.717+0000 7ff8f5889700 1 -- 172.21.15.112:0/2621965568 wait complete. 2020-11-20T11:17:57.730 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T11:17:57.731 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T11:17:57.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.841+0000 7f05c16d7700 1 Processor -- start 2020-11-20T11:17:57.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.841+0000 7f05c16d7700 1 -- start start 2020-11-20T11:17:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05c16d7700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f05bc066110 0x7f05bc0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05c16d7700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f05bc1512e0 0x7f05bc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05c16d7700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0c5230 con 0x7f05bc065d30 2020-11-20T11:17:57.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05c16d7700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0bff40 con 0x7f05bc066110 2020-11-20T11:17:57.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05c16d7700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc1549c0 con 0x7f05bc1512e0 2020-11-20T11:17:57.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f05bc066110 0x7f05bc0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f05bc066110 0x7f05bc0bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:38382/0 (socket says 172.21.15.112:38382) 2020-11-20T11:17:57.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 -- 172.21.15.112:0/1422549240 learned_addr learned my addr 172.21.15.112:0/1422549240 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05bb7fe700 1 --2- 172.21.15.112:0/1422549240 >> v2:172.21.15.204:3300/0 conn(0x7f05bc1512e0 0x7f05bc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 -- 172.21.15.112:0/1422549240 >> v2:172.21.15.204:3300/0 conn(0x7f05bc1512e0 msgr2=0x7f05bc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 --2- 172.21.15.112:0/1422549240 >> v2:172.21.15.204:3300/0 conn(0x7f05bc1512e0 0x7f05bc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 -- 172.21.15.112:0/1422549240 >> v1:172.21.15.166:6789/0 conn(0x7f05bc065d30 legacy=0x7f05bc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 -- 172.21.15.112:0/1422549240 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc154c60 con 0x7f05bc066110 2020-11-20T11:17:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05ba7fc700 1 -- 172.21.15.112:0/1422549240 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017429298 0 0) 0x7f05bc0c5230 con 0x7f05bc065d30 2020-11-20T11:17:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.842+0000 7f05b3fff700 1 --2- 172.21.15.112:0/1422549240 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc066110 0x7f05bc0bfa50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f05bc1548b0 tx=0x7f05a4006ef0).ready entity=mon.1 client_cookie=802c8565d523cedb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05ba7fc700 1 -- 172.21.15.112:0/1422549240 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400b860 con 0x7f05bc066110 2020-11-20T11:17:57.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05ba7fc700 1 -- 172.21.15.112:0/1422549240 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a4000e90 con 0x7f05bc066110 2020-11-20T11:17:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05ba7fc700 1 -- 172.21.15.112:0/1422549240 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400bbd0 con 0x7f05bc066110 2020-11-20T11:17:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 -- 172.21.15.112:0/1422549240 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc066110 msgr2=0x7f05bc0bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 --2- 172.21.15.112:0/1422549240 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc066110 0x7f05bc0bfa50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f05bc1548b0 tx=0x7f05a4006ef0).stop 2020-11-20T11:17:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 -- 172.21.15.112:0/1422549240 shutdown_connections 2020-11-20T11:17:57.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 --2- 172.21.15.112:0/1422549240 >> v2:172.21.15.204:3300/0 conn(0x7f05bc1512e0 0x7f05bc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 --2- 172.21.15.112:0/1422549240 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc066110 0x7f05bc0bfa50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 -- 172.21.15.112:0/1422549240 >> 172.21.15.112:0/1422549240 conn(0x7f05bc05bac0 msgr2=0x7f05bc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:57.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 -- 172.21.15.112:0/1422549240 shutdown_connections 2020-11-20T11:17:57.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.843+0000 7f05c16d7700 1 -- 172.21.15.112:0/1422549240 wait complete. 2020-11-20T11:17:57.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.844+0000 7f05c16d7700 1 Processor -- start 2020-11-20T11:17:57.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.844+0000 7f05c16d7700 1 -- start start 2020-11-20T11:17:57.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc065d30 0x7f05bc1518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05bc151dc0 0x7f05bc0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc1608e0 con 0x7f05bc1512e0 2020-11-20T11:17:57.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc160b80 con 0x7f05bc065d30 2020-11-20T11:17:57.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05c16d7700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc160e20 con 0x7f05bc151dc0 2020-11-20T11:17:57.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50394/0 (socket says 172.21.15.112:50394) 2020-11-20T11:17:57.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 -- 172.21.15.112:0/60240679 learned_addr learned my addr 172.21.15.112:0/60240679 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:57.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05baffd700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc065d30 0x7f05bc1518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 -- 172.21.15.112:0/60240679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05bc151dc0 msgr2=0x7f05bc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05bb7fe700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05bc151dc0 0x7f05bc0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05bc151dc0 0x7f05bc0b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 -- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc065d30 msgr2=0x7f05bc1518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:57.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.845+0000 7f05b3fff700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc065d30 0x7f05bc1518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:57.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05b3fff700 1 -- 172.21.15.112:0/60240679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1610c0 con 0x7f05bc1512e0 2020-11-20T11:17:57.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05b3fff700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f05a400c010 tx=0x7f05a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4011bb0 con 0x7f05bc1512e0 2020-11-20T11:17:57.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a4011d30 con 0x7f05bc1512e0 2020-11-20T11:17:57.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc161360 con 0x7f05bc1512e0 2020-11-20T11:17:57.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4011ea0 con 0x7f05bc1512e0 2020-11-20T11:17:57.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.846+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc155f10 con 0x7f05bc1512e0 2020-11-20T11:17:57.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.847+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc0666e0 con 0x7f05bc1512e0 2020-11-20T11:17:57.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.847+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f05a4017040 con 0x7f05bc1512e0 2020-11-20T11:17:57.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.848+0000 7f05b2ffd700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 0x7f0598082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:57.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.848+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f05a40a3ec0 con 0x7f05bc1512e0 2020-11-20T11:17:57.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.848+0000 7f05baffd700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 0x7f0598082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:57.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.848+0000 7f05baffd700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 0x7f0598082b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f05ac007fd0 tx=0x7f05ac007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:57.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.851+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f05a4078df0 con 0x7f05bc1512e0 2020-11-20T11:17:57.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:57.991+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f05bc065740 con 0x7f05bc1512e0 2020-11-20T11:17:58.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.703+0000 7f05b2ffd700 1 -- 172.21.15.112:0/60240679 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f05a4015030 con 0x7f05bc1512e0 2020-11-20T11:17:58.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 msgr2=0x7f0598082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 0x7f0598082b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f05ac007fd0 tx=0x7f05ac007bd0).stop 2020-11-20T11:17:58.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 msgr2=0x7f05bc0b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f05a400c010 tx=0x7f05a4016000).stop 2020-11-20T11:17:58.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 shutdown_connections 2020-11-20T11:17:58.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0598080670 0x7f0598082b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.706+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05bc151dc0 0x7f05bc0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.707+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f05bc065d30 0x7f05bc1518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.707+0000 7f05c16d7700 1 --2- 172.21.15.112:0/60240679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc1512e0 0x7f05bc0b0f80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.707+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 >> 172.21.15.112:0/60240679 conn(0x7f05bc05bac0 msgr2=0x7f05bc150510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:58.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.707+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 shutdown_connections 2020-11-20T11:17:58.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.707+0000 7f05c16d7700 1 -- 172.21.15.112:0/60240679 wait complete. 2020-11-20T11:17:58.712 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2020-11-20T11:17:58.723 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T11:17:58.724 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T11:17:58.842 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.839+0000 7f2d41d7e700 1 Processor -- start 2020-11-20T11:17:58.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.839+0000 7f2d41d7e700 1 -- start start 2020-11-20T11:17:58.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d41d7e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:58.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d41d7e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0c5230 con 0x7f2d3c065d30 2020-11-20T11:17:58.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d41d7e700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c1549c0 con 0x7f2d3c066110 2020-11-20T11:17:58.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d41d7e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c0bff40 con 0x7f2d3c1519f0 2020-11-20T11:17:58.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d3bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.840+0000 7f2d3bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50402/0 (socket says 172.21.15.112:50402) 2020-11-20T11:17:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3bfff700 1 -- 172.21.15.112:0/3384777015 learned_addr learned my addr 172.21.15.112:0/3384777015 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3bfff700 1 -- 172.21.15.112:0/3384777015 >> v1:172.21.15.204:6789/0 conn(0x7f2d3c066110 legacy=0x7f2d3c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3bfff700 1 -- 172.21.15.112:0/3384777015 >> v1:172.21.15.166:6789/0 conn(0x7f2d3c065d30 legacy=0x7f2d3c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3bfff700 1 -- 172.21.15.112:0/3384777015 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c154c60 con 0x7f2d3c1519f0 2020-11-20T11:17:58.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3bfff700 1 --2- 172.21.15.112:0/3384777015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2d34009d90 tx=0x7f2d340092d0).ready entity=mon.0 client_cookie=6d9c30bc9c1844aa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:58.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3a7fc700 1 -- 172.21.15.112:0/3384777015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400bbb0 con 0x7f2d3c1519f0 2020-11-20T11:17:58.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3a7fc700 1 -- 172.21.15.112:0/3384777015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400bd10 con 0x7f2d3c1519f0 2020-11-20T11:17:58.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d3a7fc700 1 -- 172.21.15.112:0/3384777015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34011610 con 0x7f2d3c1519f0 2020-11-20T11:17:58.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d41d7e700 1 -- 172.21.15.112:0/3384777015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 msgr2=0x7f2d3c0bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.841+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/3384777015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2d34009d90 tx=0x7f2d340092d0).stop 2020-11-20T11:17:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.842+0000 7f2d41d7e700 1 -- 172.21.15.112:0/3384777015 shutdown_connections 2020-11-20T11:17:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.842+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/3384777015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c0bfa50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.842+0000 7f2d41d7e700 1 -- 172.21.15.112:0/3384777015 >> 172.21.15.112:0/3384777015 conn(0x7f2d3c05bac0 msgr2=0x7f2d3c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.842+0000 7f2d41d7e700 1 -- 172.21.15.112:0/3384777015 shutdown_connections 2020-11-20T11:17:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.842+0000 7f2d41d7e700 1 -- 172.21.15.112:0/3384777015 wait complete. 2020-11-20T11:17:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.843+0000 7f2d41d7e700 1 Processor -- start 2020-11-20T11:17:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.843+0000 7f2d41d7e700 1 -- start start 2020-11-20T11:17:58.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c065d30 0x7f2d3c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:58.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2d3c066110 0x7f2d3c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:58.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:58.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c164620 con 0x7f2d3c1519f0 2020-11-20T11:17:58.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1648c0 con 0x7f2d3c066110 2020-11-20T11:17:58.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0c5a40 con 0x7f2d3c065d30 2020-11-20T11:17:58.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:58.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50410/0 (socket says 172.21.15.112:50410) 2020-11-20T11:17:58.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 -- 172.21.15.112:0/1429707161 learned_addr learned my addr 172.21.15.112:0/1429707161 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3affd700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2d3c066110 0x7f2d3c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3b7fe700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c065d30 0x7f2d3c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 -- 172.21.15.112:0/1429707161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c065d30 msgr2=0x7f2d3c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c065d30 0x7f2d3c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 -- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2d3c066110 msgr2=0x7f2d3c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2d3c066110 0x7f2d3c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 -- 172.21.15.112:0/1429707161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0c5ce0 con 0x7f2d3c1519f0 2020-11-20T11:17:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d3bfff700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2d34009130 tx=0x7f2d34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400be80 con 0x7f2d3c1519f0 2020-11-20T11:17:58.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34010b10 con 0x7f2d3c1519f0 2020-11-20T11:17:58.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c0c5f80 con 0x7f2d3c1519f0 2020-11-20T11:17:58.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34010e90 con 0x7f2d3c1519f0 2020-11-20T11:17:58.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.844+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c162030 con 0x7f2d3c1519f0 2020-11-20T11:17:58.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.845+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c0666e0 con 0x7f2d3c1519f0 2020-11-20T11:17:58.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.846+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2d34017070 con 0x7f2d3c1519f0 2020-11-20T11:17:58.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.846+0000 7f2d1b7fe700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 0x7f2d14082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:58.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.847+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f2d340a48e0 con 0x7f2d3c1519f0 2020-11-20T11:17:58.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.847+0000 7f2d3b7fe700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 0x7f2d14082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:58.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.847+0000 7f2d3b7fe700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 0x7f2d14082b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2d2c000c00 tx=0x7f2d2c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:58.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:58.850+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2d340796b0 con 0x7f2d3c1519f0 2020-11-20T11:17:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.003+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2d3c0c6110 con 0x7f2d3c1519f0 2020-11-20T11:17:59.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.706+0000 7f2d1b7fe700 1 -- 172.21.15.112:0/1429707161 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 154+0+0 (secure 0 0 0) 0x7f2d34015020 con 0x7f2d3c1519f0 2020-11-20T11:17:59.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.710+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 msgr2=0x7f2d14082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.710+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 0x7f2d14082b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2d2c000c00 tx=0x7f2d2c009040).stop 2020-11-20T11:17:59.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.710+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 msgr2=0x7f2d3c161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.710+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2d34009130 tx=0x7f2d34016000).stop 2020-11-20T11:17:59.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 shutdown_connections 2020-11-20T11:17:59.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2d14080670 0x7f2d14082b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3c1519f0 0x7f2d3c161b40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d3c065d30 0x7f2d3c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 --2- 172.21.15.112:0/1429707161 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2d3c066110 0x7f2d3c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 >> 172.21.15.112:0/1429707161 conn(0x7f2d3c05bac0 msgr2=0x7f2d3c14ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:59.716 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.711+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 shutdown_connections 2020-11-20T11:17:59.717 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.712+0000 7f2d41d7e700 1 -- 172.21.15.112:0/1429707161 wait complete. 2020-11-20T11:17:59.728 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T11:17:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.844+0000 7fd3a7439700 1 Processor -- start 2020-11-20T11:17:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 -- start start 2020-11-20T11:17:59.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fd3a0065d30 0x7fd3a0066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3a01512e0 0x7fd3a0151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00c5230 con 0x7fd3a00bfa50 2020-11-20T11:17:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a01549c0 con 0x7fd3a0065d30 2020-11-20T11:17:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.845+0000 7fd3a7439700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a0154c60 con 0x7fd3a01512e0 2020-11-20T11:17:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a49d4700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd3a00bfa50 0x7fd3a00c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34616/0 (socket says 172.21.15.112:34616) 2020-11-20T11:17:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a49d4700 1 -- 172.21.15.112:0/900175308 learned_addr learned my addr 172.21.15.112:0/900175308 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:17:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/900175308 >> v2:172.21.15.204:3300/0 conn(0x7fd3a01512e0 0x7fd3a0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715125415 0 0) 0x7fd3a00c5230 con 0x7fd3a00bfa50 2020-11-20T11:17:59.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd388003280 con 0x7fd3a00bfa50 2020-11-20T11:17:59.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a51d5700 1 --2- 172.21.15.112:0/900175308 >> v2:172.21.15.166:3300/0 conn(0x7fd3a0065d30 0x7fd3a0066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2099544788 0 0) 0x7fd388003280 con 0x7fd3a00bfa50 2020-11-20T11:17:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 >> v2:172.21.15.204:3300/0 conn(0x7fd3a01512e0 msgr2=0x7fd3a0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 --2- 172.21.15.112:0/900175308 >> v2:172.21.15.204:3300/0 conn(0x7fd3a01512e0 0x7fd3a0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 >> v2:172.21.15.166:3300/0 conn(0x7fd3a0065d30 msgr2=0x7fd3a0066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 --2- 172.21.15.112:0/900175308 >> v2:172.21.15.166:3300/0 conn(0x7fd3a0065d30 0x7fd3a0066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0154f00 con 0x7fd3a00bfa50 2020-11-20T11:17:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fd390001520 con 0x7fd3a00bfa50 2020-11-20T11:17:59.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 >> v1:172.21.15.112:6789/0 conn(0x7fd3a00bfa50 legacy=0x7fd3a00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3880037c0 0x7fd388003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd388004520 0x7fd3880049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd38800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01549c0 con 0x7fd388004e90 2020-11-20T11:17:59.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0154c60 con 0x7fd388004520 2020-11-20T11:17:59.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880053f0 con 0x7fd3880037c0 2020-11-20T11:17:59.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd38800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a51d5700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3880037c0 0x7fd388003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.846+0000 7fd3a49d4700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd388004520 0x7fd3880049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 -- 172.21.15.112:0/900175308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3880037c0 msgr2=0x7fd388003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:59.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3880037c0 0x7fd388003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 -- 172.21.15.112:0/900175308 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd388004520 msgr2=0x7fd3880049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:17:59.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd388004520 0x7fd3880049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 -- 172.21.15.112:0/900175308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388003280 con 0x7fd388004e90 2020-11-20T11:17:59.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 -- 172.21.15.112:0/900175308 reap_dead start 2020-11-20T11:17:59.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd38800b770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd398009ef0 tx=0x7fd398009220).ready entity=mon.0 client_cookie=9a6404adcf50ce35 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:59.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398009610 con 0x7fd388004e90 2020-11-20T11:17:59.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398017d30 con 0x7fd388004e90 2020-11-20T11:17:59.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd38ffff700 1 -- 172.21.15.112:0/900175308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398017ea0 con 0x7fd388004e90 2020-11-20T11:17:59.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 -- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 msgr2=0x7fd38800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd38800b770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd398009ef0 tx=0x7fd398009220).stop 2020-11-20T11:17:59.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 -- 172.21.15.112:0/900175308 shutdown_connections 2020-11-20T11:17:59.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 --2- 172.21.15.112:0/900175308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd38800b770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 -- 172.21.15.112:0/900175308 >> 172.21.15.112:0/900175308 conn(0x7fd3a005bac0 msgr2=0x7fd3a005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:17:59.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 -- 172.21.15.112:0/900175308 shutdown_connections 2020-11-20T11:17:59.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.847+0000 7fd3a7439700 1 -- 172.21.15.112:0/900175308 wait complete. 2020-11-20T11:17:59.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.848+0000 7fd3a7439700 1 Processor -- start 2020-11-20T11:17:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.848+0000 7fd3a7439700 1 -- start start 2020-11-20T11:17:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd3a0146020 0x7fd3a014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3a014e220 0x7fd3a01484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00bea10 con 0x7fd388004e90 2020-11-20T11:17:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00c3c20 con 0x7fd3a0146020 2020-11-20T11:17:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a7439700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00c2d00 con 0x7fd3a014e220 2020-11-20T11:17:59.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a51d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a51d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50430/0 (socket says 172.21.15.112:50430) 2020-11-20T11:17:59.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.849+0000 7fd3a51d5700 1 -- 172.21.15.112:0/117851242 learned_addr learned my addr 172.21.15.112:0/117851242 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:17:59.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a59d6700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3a014e220 0x7fd3a01484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a49d4700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd3a0146020 0x7fd3a014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 -- 172.21.15.112:0/117851242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3a014e220 msgr2=0x7fd3a01484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3a014e220 0x7fd3a01484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 -- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd3a0146020 msgr2=0x7fd3a014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:17:59.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd3a0146020 0x7fd3a014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:17:59.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 -- 172.21.15.112:0/117851242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00c2fa0 con 0x7fd388004e90 2020-11-20T11:17:59.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a51d5700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd39c011c90 tx=0x7fd39c006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:59.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c018070 con 0x7fd388004e90 2020-11-20T11:17:59.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c000e90 con 0x7fd388004e90 2020-11-20T11:17:59.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00fcd0 con 0x7fd388004e90 2020-11-20T11:17:59.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a00c3240 con 0x7fd388004e90 2020-11-20T11:17:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.850+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a00c3780 con 0x7fd388004e90 2020-11-20T11:17:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.851+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a00c3940 con 0x7fd388004e90 2020-11-20T11:17:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.852+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd39c014650 con 0x7fd388004e90 2020-11-20T11:17:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.852+0000 7fd38d7fa700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 0x7fd37c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:17:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.852+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7703+0+0 (secure 0 0 0) 0x7fd39c0a2da0 con 0x7fd388004e90 2020-11-20T11:17:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.852+0000 7fd3a49d4700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 0x7fd37c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:17:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.853+0000 7fd3a49d4700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 0x7fd37c082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd3900013f0 tx=0x7fd390009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:17:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.856+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd39c077a70 con 0x7fd388004e90 2020-11-20T11:17:59.999 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:17:59.996+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fd3a00666e0 con 0x7fd388004e90 2020-11-20T11:18:01.722 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.719+0000 7fd38d7fa700 1 -- 172.21.15.112:0/117851242 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v27) v1 ==== 188+0+0 (secure 0 0 0) 0x7fd39c07b090 con 0x7fd388004e90 2020-11-20T11:18:01.726 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.722+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 msgr2=0x7fd37c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.727 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.722+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 0x7fd37c082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd3900013f0 tx=0x7fd390009040).stop 2020-11-20T11:18:01.727 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.722+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 msgr2=0x7fd3a0145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.727 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.722+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd39c011c90 tx=0x7fd39c006e30).stop 2020-11-20T11:18:01.728 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 shutdown_connections 2020-11-20T11:18:01.728 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd37c080670 0x7fd37c082b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.728 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3a014e220 0x7fd3a01484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.729 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd388004e90 0x7fd3a0145b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.729 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 --2- 172.21.15.112:0/117851242 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd3a0146020 0x7fd3a014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 >> 172.21.15.112:0/117851242 conn(0x7fd3a005bac0 msgr2=0x7fd3a0147bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:01.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 shutdown_connections 2020-11-20T11:18:01.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.723+0000 7fd3a7439700 1 -- 172.21.15.112:0/117851242 wait complete. 2020-11-20T11:18:01.731 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2020-11-20T11:18:01.741 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T11:18:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.855+0000 7f061ffff700 1 Processor -- start 2020-11-20T11:18:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.855+0000 7f061ffff700 1 -- start start 2020-11-20T11:18:01.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06200c7a10 0x7f06200c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061ffff700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 0x7f06200c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061ffff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620060790 con 0x7f06200601b0 2020-11-20T11:18:01.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061ffff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200c4150 con 0x7f06200c7a10 2020-11-20T11:18:01.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061ffff700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0620060a30 con 0x7f06200c4810 2020-11-20T11:18:01.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f061effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06200c7a10 0x7f06200c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f0617fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f06200601b0 0x7f06200bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34634/0 (socket says 172.21.15.112:34634) 2020-11-20T11:18:01.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.856+0000 7f0617fff700 1 -- 172.21.15.112:0/3586262123 learned_addr learned my addr 172.21.15.112:0/3586262123 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:01.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061f7fe700 1 --2- 172.21.15.112:0/3586262123 >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 0x7f06200c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061effd700 1 -- 172.21.15.112:0/3586262123 >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 msgr2=0x7f06200c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:01.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061effd700 1 --2- 172.21.15.112:0/3586262123 >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 0x7f06200c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061effd700 1 -- 172.21.15.112:0/3586262123 >> v1:172.21.15.112:6789/0 conn(0x7f06200601b0 legacy=0x7f06200bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061effd700 1 -- 172.21.15.112:0/3586262123 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620060cd0 con 0x7f06200c7a10 2020-11-20T11:18:01.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061e7fc700 1 -- 172.21.15.112:0/3586262123 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703591453 0 0) 0x7f0620060790 con 0x7f06200601b0 2020-11-20T11:18:01.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061f7fe700 1 --2- 172.21.15.112:0/3586262123 >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 0x7f06200c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:01.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061effd700 1 --2- 172.21.15.112:0/3586262123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f06200c7df0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f06200c21c0 tx=0x7f0610006e30).ready entity=mon.0 client_cookie=e30979d67a19b686 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:01.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061e7fc700 1 -- 172.21.15.112:0/3586262123 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100097b0 con 0x7f06200c7a10 2020-11-20T11:18:01.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061e7fc700 1 -- 172.21.15.112:0/3586262123 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610000e90 con 0x7f06200c7a10 2020-11-20T11:18:01.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061e7fc700 1 -- 172.21.15.112:0/3586262123 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610009b20 con 0x7f06200c7a10 2020-11-20T11:18:01.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 -- 172.21.15.112:0/3586262123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 msgr2=0x7f06200c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 --2- 172.21.15.112:0/3586262123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f06200c7df0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f06200c21c0 tx=0x7f0610006e30).stop 2020-11-20T11:18:01.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 -- 172.21.15.112:0/3586262123 shutdown_connections 2020-11-20T11:18:01.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 --2- 172.21.15.112:0/3586262123 >> v2:172.21.15.204:3300/0 conn(0x7f06200c4810 0x7f06200c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 --2- 172.21.15.112:0/3586262123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f06200c7df0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 -- 172.21.15.112:0/3586262123 >> 172.21.15.112:0/3586262123 conn(0x7f062005bac0 msgr2=0x7f0620062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 -- 172.21.15.112:0/3586262123 shutdown_connections 2020-11-20T11:18:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.857+0000 7f061ffff700 1 -- 172.21.15.112:0/3586262123 wait complete. 2020-11-20T11:18:01.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.858+0000 7f061ffff700 1 Processor -- start 2020-11-20T11:18:01.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 -- start start 2020-11-20T11:18:01.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200601b0 0x7f06201549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 0x7f062014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200c1a30 con 0x7f06200c7a10 2020-11-20T11:18:01.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620161440 con 0x7f06200c4810 2020-11-20T11:18:01.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061ffff700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620160720 con 0x7f06200601b0 2020-11-20T11:18:01.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50448/0 (socket says 172.21.15.112:50448) 2020-11-20T11:18:01.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.859+0000 7f061f7fe700 1 -- 172.21.15.112:0/3513329696 learned_addr learned my addr 172.21.15.112:0/3513329696 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:01.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061effd700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200601b0 0x7f06201549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f0617fff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 0x7f062014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 -- 172.21.15.112:0/3513329696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200601b0 msgr2=0x7f06201549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200601b0 0x7f06201549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 -- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 msgr2=0x7f062014e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:01.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 0x7f062014e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:01.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 -- 172.21.15.112:0/3513329696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06201609c0 con 0x7f06200c7a10 2020-11-20T11:18:01.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f0617fff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 0x7f062014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:01.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061f7fe700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f061800cbd0 tx=0x7f0618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:01.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800a9e0 con 0x7f06200c7a10 2020-11-20T11:18:01.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800ab40 con 0x7f06200c7a10 2020-11-20T11:18:01.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011410 con 0x7f06200c7a10 2020-11-20T11:18:01.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0620160c60 con 0x7f06200c7a10 2020-11-20T11:18:01.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.860+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201611a0 con 0x7f06200c7a10 2020-11-20T11:18:01.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.861+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06200008d0 con 0x7f06200c7a10 2020-11-20T11:18:01.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.861+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f06180117c0 con 0x7f06200c7a10 2020-11-20T11:18:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.862+0000 7f0616ffd700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 0x7f05fc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.862+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f06180a39b0 con 0x7f06200c7a10 2020-11-20T11:18:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.862+0000 7f061effd700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 0x7f05fc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.863+0000 7f061effd700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 0x7f05fc082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0610006e70 tx=0x7f0610015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:01.865+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f06180784c0 con 0x7f06200c7a10 2020-11-20T11:18:02.008 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.004+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f0620065680 con 0x7f06200c7a10 2020-11-20T11:18:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.724+0000 7f0616ffd700 1 -- 172.21.15.112:0/3513329696 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v28) v1 ==== 166+0+0 (secure 0 0 0) 0x7f061807bae0 con 0x7f06200c7a10 2020-11-20T11:18:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 msgr2=0x7f05fc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 0x7f05fc082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0610006e70 tx=0x7f0610015000).stop 2020-11-20T11:18:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 msgr2=0x7f0620153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f061800cbd0 tx=0x7f0618008040).stop 2020-11-20T11:18:02.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 shutdown_connections 2020-11-20T11:18:02.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f05fc080670 0x7f05fc082b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06200c7a10 0x7f0620153c50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200601b0 0x7f06201549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.732 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 --2- 172.21.15.112:0/3513329696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06200c4810 0x7f062014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.732 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 >> 172.21.15.112:0/3513329696 conn(0x7f062005bac0 msgr2=0x7f06200c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:02.732 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 shutdown_connections 2020-11-20T11:18:02.732 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.727+0000 7f061ffff700 1 -- 172.21.15.112:0/3513329696 wait complete. 2020-11-20T11:18:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T11:18:02.743 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T11:18:02.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.854+0000 7f9c371e4700 1 Processor -- start 2020-11-20T11:18:02.857 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.854+0000 7f9c371e4700 1 -- start start 2020-11-20T11:18:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c371e4700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f9c30065d30 0x7f9c30066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c371e4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c300c5230 con 0x7f9c300bfa50 2020-11-20T11:18:02.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c371e4700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c301549c0 con 0x7f9c301512e0 2020-11-20T11:18:02.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c371e4700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c30154c60 con 0x7f9c30065d30 2020-11-20T11:18:02.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9c300bfa50 0x7f9c300c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34646/0 (socket says 172.21.15.112:34646) 2020-11-20T11:18:02.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2ffff700 1 -- 172.21.15.112:0/1229949130 learned_addr learned my addr 172.21.15.112:0/1229949130 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:02.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24369533 0 0) 0x7f9c300c5230 con 0x7f9c300bfa50 2020-11-20T11:18:02.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c14003280 con 0x7f9c300bfa50 2020-11-20T11:18:02.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c34f80700 1 --2- 172.21.15.112:0/1229949130 >> v2:172.21.15.166:3300/0 conn(0x7f9c30065d30 0x7f9c30066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 829999748 0 0) 0x7f9c14003280 con 0x7f9c300bfa50 2020-11-20T11:18:02.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 >> v2:172.21.15.166:3300/0 conn(0x7f9c30065d30 msgr2=0x7f9c30066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 --2- 172.21.15.112:0/1229949130 >> v2:172.21.15.166:3300/0 conn(0x7f9c30065d30 0x7f9c30066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 >> v1:172.21.15.204:6789/0 conn(0x7f9c301512e0 legacy=0x7f9c30151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30154f00 con 0x7f9c300bfa50 2020-11-20T11:18:02.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.855+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f9c1c001520 con 0x7f9c300bfa50 2020-11-20T11:18:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 >> v1:172.21.15.112:6789/0 conn(0x7f9c300bfa50 legacy=0x7f9c300c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c140037c0 0x7f9c14003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c140049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c14004e90 0x7f9c1400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30154c60 con 0x7f9c14004520 2020-11-20T11:18:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140053f0 con 0x7f9c140037c0 2020-11-20T11:18:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1400bce0 con 0x7f9c14004e90 2020-11-20T11:18:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c140049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c34f80700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c140037c0 0x7f9c14003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 -- 172.21.15.112:0/1229949130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c14004e90 msgr2=0x7f9c1400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c35781700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c14004e90 0x7f9c1400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c14004e90 0x7f9c1400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 -- 172.21.15.112:0/1229949130 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c140037c0 msgr2=0x7f9c14003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c140037c0 0x7f9c14003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 -- 172.21.15.112:0/1229949130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14003280 con 0x7f9c14004520 2020-11-20T11:18:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c35781700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c14004e90 0x7f9c1400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c35781700 1 -- 172.21.15.112:0/1229949130 reap_dead start 2020-11-20T11:18:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c140049a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c1c00c440 tx=0x7f9c30155090).ready entity=mon.0 client_cookie=106b0869843ebd7d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:02.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00ce40 con 0x7f9c14004520 2020-11-20T11:18:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0072e0 con 0x7f9c14004520 2020-11-20T11:18:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.856+0000 7f9c2f7fe700 1 -- 172.21.15.112:0/1229949130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c005630 con 0x7f9c14004520 2020-11-20T11:18:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 -- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 msgr2=0x7f9c140049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c140049a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c1c00c440 tx=0x7f9c30155090).stop 2020-11-20T11:18:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 -- 172.21.15.112:0/1229949130 shutdown_connections 2020-11-20T11:18:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 --2- 172.21.15.112:0/1229949130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c140049a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 -- 172.21.15.112:0/1229949130 >> 172.21.15.112:0/1229949130 conn(0x7f9c3005bac0 msgr2=0x7f9c3005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 -- 172.21.15.112:0/1229949130 shutdown_connections 2020-11-20T11:18:02.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.857+0000 7f9c371e4700 1 -- 172.21.15.112:0/1229949130 wait complete. 2020-11-20T11:18:02.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.858+0000 7f9c371e4700 1 Processor -- start 2020-11-20T11:18:02.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.858+0000 7f9c371e4700 1 -- start start 2020-11-20T11:18:02.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c30157010 0x7f9c30149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c30164740 0x7f9c3014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30157490 con 0x7f9c14004520 2020-11-20T11:18:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30153430 con 0x7f9c30164740 2020-11-20T11:18:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301536d0 con 0x7f9c30157010 2020-11-20T11:18:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50462/0 (socket says 172.21.15.112:50462) 2020-11-20T11:18:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 -- 172.21.15.112:0/3908266937 learned_addr learned my addr 172.21.15.112:0/3908266937 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c35781700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c30164740 0x7f9c3014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c30157010 0x7f9c30149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 -- 172.21.15.112:0/3908266937 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c30157010 msgr2=0x7f9c30149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c30157010 0x7f9c30149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 -- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c30164740 msgr2=0x7f9c3014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c30164740 0x7f9c3014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 -- 172.21.15.112:0/3908266937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30153970 con 0x7f9c14004520 2020-11-20T11:18:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c34f80700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9c24011cc0 tx=0x7f9c24006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400fa40 con 0x7f9c14004520 2020-11-20T11:18:02.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c24000e90 con 0x7f9c14004520 2020-11-20T11:18:02.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3014ce40 con 0x7f9c14004520 2020-11-20T11:18:02.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400fdb0 con 0x7f9c14004520 2020-11-20T11:18:02.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.859+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30164b80 con 0x7f9c14004520 2020-11-20T11:18:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.860+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3014d2a0 con 0x7f9c14004520 2020-11-20T11:18:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.861+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9c24014650 con 0x7f9c14004520 2020-11-20T11:18:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.861+0000 7f9c2cff9700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 0x7f9c08082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.861+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f9c240a3150 con 0x7f9c14004520 2020-11-20T11:18:02.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.861+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 0x7f9c08082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:02.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.862+0000 7f9c2ffff700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 0x7f9c08082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9c1c007940 tx=0x7f9c1c013000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:02.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:02.865+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9c24077c60 con 0x7f9c14004520 2020-11-20T11:18:03.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.055+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9c300666e0 con 0x7f9c14004520 2020-11-20T11:18:03.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.059+0000 7f9c2cff9700 1 -- 172.21.15.112:0/3908266937 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7f9c24018070 con 0x7f9c14004520 2020-11-20T11:18:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 msgr2=0x7f9c08082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 0x7f9c08082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9c1c007940 tx=0x7f9c1c013000).stop 2020-11-20T11:18:03.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 msgr2=0x7f9c30154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9c24011cc0 tx=0x7f9c24006e30).stop 2020-11-20T11:18:03.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 shutdown_connections 2020-11-20T11:18:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9c08080670 0x7f9c08082b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9c30164740 0x7f9c3014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c14004520 0x7f9c30154020 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 --2- 172.21.15.112:0/3908266937 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c30157010 0x7f9c30149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 >> 172.21.15.112:0/3908266937 conn(0x7f9c3005bac0 msgr2=0x7f9c3014f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 shutdown_connections 2020-11-20T11:18:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.063+0000 7f9c371e4700 1 -- 172.21.15.112:0/3908266937 wait complete. 2020-11-20T11:18:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T11:18:03.081 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:03.190 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.187+0000 7f48cb057700 1 Processor -- start 2020-11-20T11:18:03.190 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.187+0000 7f48cb057700 1 -- start start 2020-11-20T11:18:03.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48cb057700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f48c4066110 0x7f48c40bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48cb057700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48c41512e0 0x7f48c4151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48cb057700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40c5230 con 0x7f48c4065d30 2020-11-20T11:18:03.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48cb057700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40bff40 con 0x7f48c41512e0 2020-11-20T11:18:03.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48cb057700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c41549c0 con 0x7f48c4066110 2020-11-20T11:18:03.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48c41512e0 0x7f48c4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48c41512e0 0x7f48c4151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50482/0 (socket says 172.21.15.112:50482) 2020-11-20T11:18:03.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 -- 172.21.15.112:0/633570277 learned_addr learned my addr 172.21.15.112:0/633570277 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c3fff700 1 --2- 172.21.15.112:0/633570277 >> v2:172.21.15.166:3300/0 conn(0x7f48c4066110 0x7f48c40bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 -- 172.21.15.112:0/633570277 >> v2:172.21.15.166:3300/0 conn(0x7f48c4066110 msgr2=0x7f48c40bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:03.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 --2- 172.21.15.112:0/633570277 >> v2:172.21.15.166:3300/0 conn(0x7f48c4066110 0x7f48c40bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 -- 172.21.15.112:0/633570277 >> v1:172.21.15.166:6789/0 conn(0x7f48c4065d30 legacy=0x7f48c40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:03.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 -- 172.21.15.112:0/633570277 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4154c60 con 0x7f48c41512e0 2020-11-20T11:18:03.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c95f4700 1 --2- 172.21.15.112:0/633570277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c4151710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f48c40651b0 tx=0x7f48bc0092d0).ready entity=mon.0 client_cookie=b7a172ecb27cc5d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.188+0000 7f48c37fe700 1 -- 172.21.15.112:0/633570277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00bbb0 con 0x7f48c41512e0 2020-11-20T11:18:03.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48c37fe700 1 -- 172.21.15.112:0/633570277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc00bd10 con 0x7f48c41512e0 2020-11-20T11:18:03.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48c37fe700 1 -- 172.21.15.112:0/633570277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc011610 con 0x7f48c41512e0 2020-11-20T11:18:03.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 -- 172.21.15.112:0/633570277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 msgr2=0x7f48c4151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 --2- 172.21.15.112:0/633570277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c4151710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f48c40651b0 tx=0x7f48bc0092d0).stop 2020-11-20T11:18:03.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 -- 172.21.15.112:0/633570277 shutdown_connections 2020-11-20T11:18:03.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 --2- 172.21.15.112:0/633570277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c4151710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 --2- 172.21.15.112:0/633570277 >> v2:172.21.15.166:3300/0 conn(0x7f48c4066110 0x7f48c40bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 -- 172.21.15.112:0/633570277 >> 172.21.15.112:0/633570277 conn(0x7f48c405bac0 msgr2=0x7f48c405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 -- 172.21.15.112:0/633570277 shutdown_connections 2020-11-20T11:18:03.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.189+0000 7f48cb057700 1 -- 172.21.15.112:0/633570277 wait complete. 2020-11-20T11:18:03.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.190+0000 7f48cb057700 1 Processor -- start 2020-11-20T11:18:03.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.190+0000 7f48cb057700 1 -- start start 2020-11-20T11:18:03.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f48c4065d30 0x7f48c4160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48c4066110 0x7f48c40b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40b0f00 con 0x7f48c41512e0 2020-11-20T11:18:03.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c58c0 con 0x7f48c4065d30 2020-11-20T11:18:03.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48cb057700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41613d0 con 0x7f48c4066110 2020-11-20T11:18:03.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50490/0 (socket says 172.21.15.112:50490) 2020-11-20T11:18:03.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 -- 172.21.15.112:0/3714563087 learned_addr learned my addr 172.21.15.112:0/3714563087 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 -- 172.21.15.112:0/3714563087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48c4066110 msgr2=0x7f48c40b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c3fff700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48c4066110 0x7f48c40b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c8df3700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f48c4065d30 0x7f48c4160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48c4066110 0x7f48c40b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 -- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f48c4065d30 msgr2=0x7f48c4160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f48c4065d30 0x7f48c4160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.191+0000 7f48c95f4700 1 -- 172.21.15.112:0/3714563087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40b29f0 con 0x7f48c41512e0 2020-11-20T11:18:03.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48c95f4700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f48bc009310 tx=0x7f48bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00be80 con 0x7f48c41512e0 2020-11-20T11:18:03.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc011e30 con 0x7f48c41512e0 2020-11-20T11:18:03.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c40c5af0 con 0x7f48c41512e0 2020-11-20T11:18:03.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc010dd0 con 0x7f48c41512e0 2020-11-20T11:18:03.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.192+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c40c6030 con 0x7f48c41512e0 2020-11-20T11:18:03.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.193+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c40b2740 con 0x7f48c41512e0 2020-11-20T11:18:03.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.193+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f48bc017070 con 0x7f48c41512e0 2020-11-20T11:18:03.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.194+0000 7f48c0ff9700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 0x7f489c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.194+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f48bc0a4c60 con 0x7f48c41512e0 2020-11-20T11:18:03.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.194+0000 7f48c8df3700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 0x7f489c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.194+0000 7f48c8df3700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 0x7f489c082b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f48b800a610 tx=0x7f48b8008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.197+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f48bc0795f0 con 0x7f48c41512e0 2020-11-20T11:18:03.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.337+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c4065740 con 0x7f48c41512e0 2020-11-20T11:18:03.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.338+0000 7f48c0ff9700 1 -- 172.21.15.112:0/3714563087 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f48bc015030 con 0x7f48c41512e0 2020-11-20T11:18:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:03.342 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:03.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 msgr2=0x7f489c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 0x7f489c082b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f48b800a610 tx=0x7f48b8008040).stop 2020-11-20T11:18:03.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 msgr2=0x7f48c40b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f48bc009310 tx=0x7f48bc016000).stop 2020-11-20T11:18:03.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 shutdown_connections 2020-11-20T11:18:03.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f489c080670 0x7f489c082b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48c41512e0 0x7f48c40b0500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f48c4065d30 0x7f48c4160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 --2- 172.21.15.112:0/3714563087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48c4066110 0x7f48c40b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 >> 172.21.15.112:0/3714563087 conn(0x7f48c405bac0 msgr2=0x7f48c4060910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 shutdown_connections 2020-11-20T11:18:03.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.340+0000 7f48cb057700 1 -- 172.21.15.112:0/3714563087 wait complete. 2020-11-20T11:18:03.355 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.460+0000 7f0967bde700 1 Processor -- start 2020-11-20T11:18:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.460+0000 7f0967bde700 1 -- start start 2020-11-20T11:18:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f0967bde700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0960065d30 0x7f0960066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f0967bde700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600c5230 con 0x7f09601512e0 2020-11-20T11:18:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f0967bde700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09601549c0 con 0x7f09600bfa50 2020-11-20T11:18:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f0967bde700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0960154c60 con 0x7f0960065d30 2020-11-20T11:18:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f096597a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0960065d30 0x7f0960066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f096597a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0960065d30 0x7f0960066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50494/0 (socket says 172.21.15.112:50494) 2020-11-20T11:18:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f096597a700 1 -- 172.21.15.112:0/3786899451 learned_addr learned my addr 172.21.15.112:0/3786899451 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.461+0000 7f096617b700 1 --1- 172.21.15.112:0/3786899451 >> v1:172.21.15.112:6789/0 conn(0x7f09601512e0 0x7f0960151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34690/0 (socket says 172.21.15.112:34690) 2020-11-20T11:18:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f096597a700 1 -- 172.21.15.112:0/3786899451 >> v1:172.21.15.204:6789/0 conn(0x7f09600bfa50 legacy=0x7f09600c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f096597a700 1 -- 172.21.15.112:0/3786899451 >> v1:172.21.15.112:6789/0 conn(0x7f09601512e0 legacy=0x7f0960151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f096597a700 1 -- 172.21.15.112:0/3786899451 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960154f00 con 0x7f0960065d30 2020-11-20T11:18:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0964978700 1 -- 172.21.15.112:0/3786899451 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165905889 0 0) 0x7f09600c5230 con 0x7f09601512e0 2020-11-20T11:18:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f096597a700 1 --2- 172.21.15.112:0/3786899451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0960065d30 0x7f0960066110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f095c009a10 tx=0x7f095c006ef0).ready entity=mon.0 client_cookie=7b67ad4739a573ff server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0964978700 1 -- 172.21.15.112:0/3786899451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00b820 con 0x7f0960065d30 2020-11-20T11:18:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0964978700 1 -- 172.21.15.112:0/3786899451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c000e90 con 0x7f0960065d30 2020-11-20T11:18:03.469 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0964978700 1 -- 172.21.15.112:0/3786899451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00bb90 con 0x7f0960065d30 2020-11-20T11:18:03.469 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 -- 172.21.15.112:0/3786899451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0960065d30 msgr2=0x7f0960066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.469 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 --2- 172.21.15.112:0/3786899451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0960065d30 0x7f0960066110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f095c009a10 tx=0x7f095c006ef0).stop 2020-11-20T11:18:03.469 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 -- 172.21.15.112:0/3786899451 shutdown_connections 2020-11-20T11:18:03.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 --2- 172.21.15.112:0/3786899451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0960065d30 0x7f0960066110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 -- 172.21.15.112:0/3786899451 >> 172.21.15.112:0/3786899451 conn(0x7f096005bac0 msgr2=0x7f096005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 -- 172.21.15.112:0/3786899451 shutdown_connections 2020-11-20T11:18:03.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.462+0000 7f0967bde700 1 -- 172.21.15.112:0/3786899451 wait complete. 2020-11-20T11:18:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.463+0000 7f0967bde700 1 Processor -- start 2020-11-20T11:18:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 -- start start 2020-11-20T11:18:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 0x7f09601609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 0x7f09600c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601611b0 con 0x7f09601512e0 2020-11-20T11:18:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960161450 con 0x7f0960065d30 2020-11-20T11:18:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f0967bde700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601616f0 con 0x7f09600bfa50 2020-11-20T11:18:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f096617b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f096617b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50500/0 (socket says 172.21.15.112:50500) 2020-11-20T11:18:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f096617b700 1 -- 172.21.15.112:0/3754245670 learned_addr learned my addr 172.21.15.112:0/3754245670 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.464+0000 7f096597a700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 0x7f09601609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f0965179700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 0x7f09600c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 -- 172.21.15.112:0/3754245670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 msgr2=0x7f09600c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 0x7f09600c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 -- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 msgr2=0x7f09601609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 0x7f09601609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 -- 172.21.15.112:0/3754245670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600c6530 con 0x7f09601512e0 2020-11-20T11:18:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096597a700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 0x7f09601609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f0965179700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 0x7f09600c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f096617b700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f095800cab0 tx=0x7f0958001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958005b00 con 0x7f09601512e0 2020-11-20T11:18:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0958005c60 con 0x7f09601512e0 2020-11-20T11:18:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958007110 con 0x7f09601512e0 2020-11-20T11:18:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600c67d0 con 0x7f09601512e0 2020-11-20T11:18:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.465+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09600c0880 con 0x7f09601512e0 2020-11-20T11:18:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.466+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09601618b0 con 0x7f09601512e0 2020-11-20T11:18:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.466+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0958010030 con 0x7f09601512e0 2020-11-20T11:18:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.467+0000 7f094dffb700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 0x7f0938082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.467+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f09580a2a30 con 0x7f09601512e0 2020-11-20T11:18:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.467+0000 7f096597a700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 0x7f0938082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.480 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.467+0000 7f096597a700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 0x7f0938082b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f095c00c010 tx=0x7f095c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.480 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.470+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0958077440 con 0x7f09601512e0 2020-11-20T11:18:03.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.610+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09600c6370 con 0x7f09601512e0 2020-11-20T11:18:03.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.611+0000 7f094dffb700 1 -- 172.21.15.112:0/3754245670 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f095807aa60 con 0x7f09601512e0 2020-11-20T11:18:03.614 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:03.615 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:03.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 msgr2=0x7f0938082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 0x7f0938082b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f095c00c010 tx=0x7f095c015000).stop 2020-11-20T11:18:03.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 msgr2=0x7f09600b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f095800cab0 tx=0x7f0958001360).stop 2020-11-20T11:18:03.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 shutdown_connections 2020-11-20T11:18:03.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0938080670 0x7f0938082b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09601512e0 0x7f09600b14c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0960065d30 0x7f09601609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 --2- 172.21.15.112:0/3754245670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09600bfa50 0x7f09600c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 >> 172.21.15.112:0/3754245670 conn(0x7f096005bac0 msgr2=0x7f09600c1190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 shutdown_connections 2020-11-20T11:18:03.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.613+0000 7f0967bde700 1 -- 172.21.15.112:0/3754245670 wait complete. 2020-11-20T11:18:03.628 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T11:18:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.736+0000 7f645119d700 1 Processor -- start 2020-11-20T11:18:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.736+0000 7f645119d700 1 -- start start 2020-11-20T11:18:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f645119d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f644c1519f0 0x7f644c0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f645119d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c0c5230 con 0x7f644c066110 2020-11-20T11:18:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f645119d700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c1549c0 con 0x7f644c065d30 2020-11-20T11:18:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f645119d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0bff40 con 0x7f644c1519f0 2020-11-20T11:18:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f644c1519f0 0x7f644c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f644c1519f0 0x7f644c0bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50510/0 (socket says 172.21.15.112:50510) 2020-11-20T11:18:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 -- 172.21.15.112:0/421799025 learned_addr learned my addr 172.21.15.112:0/421799025 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644a59c700 1 --1- 172.21.15.112:0/421799025 >> v1:172.21.15.112:6789/0 conn(0x7f644c066110 0x7f644c1512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34702/0 (socket says 172.21.15.112:34702) 2020-11-20T11:18:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 -- 172.21.15.112:0/421799025 >> v1:172.21.15.166:6789/0 conn(0x7f644c065d30 legacy=0x7f644c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 -- 172.21.15.112:0/421799025 >> v1:172.21.15.112:6789/0 conn(0x7f644c066110 legacy=0x7f644c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 -- 172.21.15.112:0/421799025 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c154c60 con 0x7f644c1519f0 2020-11-20T11:18:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f6449d9b700 1 -- 172.21.15.112:0/421799025 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337290232 0 0) 0x7f644c0c5230 con 0x7f644c066110 2020-11-20T11:18:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f644b59e700 1 --2- 172.21.15.112:0/421799025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c1519f0 0x7f644c0bfa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6444009d90 tx=0x7f64440092d0).ready entity=mon.0 client_cookie=8183583fa622513f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f6449d9b700 1 -- 172.21.15.112:0/421799025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400bbb0 con 0x7f644c1519f0 2020-11-20T11:18:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f6449d9b700 1 -- 172.21.15.112:0/421799025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644400bd10 con 0x7f644c1519f0 2020-11-20T11:18:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.737+0000 7f6449d9b700 1 -- 172.21.15.112:0/421799025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444011610 con 0x7f644c1519f0 2020-11-20T11:18:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 -- 172.21.15.112:0/421799025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c1519f0 msgr2=0x7f644c0bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 --2- 172.21.15.112:0/421799025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c1519f0 0x7f644c0bfa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6444009d90 tx=0x7f64440092d0).stop 2020-11-20T11:18:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 -- 172.21.15.112:0/421799025 shutdown_connections 2020-11-20T11:18:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 --2- 172.21.15.112:0/421799025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c1519f0 0x7f644c0bfa50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 -- 172.21.15.112:0/421799025 >> 172.21.15.112:0/421799025 conn(0x7f644c05bac0 msgr2=0x7f644c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 -- 172.21.15.112:0/421799025 shutdown_connections 2020-11-20T11:18:03.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.738+0000 7f645119d700 1 -- 172.21.15.112:0/421799025 wait complete. 2020-11-20T11:18:03.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.739+0000 7f645119d700 1 Processor -- start 2020-11-20T11:18:03.747 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.739+0000 7f645119d700 1 -- start start 2020-11-20T11:18:03.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f644c066110 0x7f644c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 0x7f644c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c160620 con 0x7f644c065d30 2020-11-20T11:18:03.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c14dce0 con 0x7f644c1519f0 2020-11-20T11:18:03.752 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f645119d700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0be110 con 0x7f644c066110 2020-11-20T11:18:03.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50512/0 (socket says 172.21.15.112:50512) 2020-11-20T11:18:03.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 -- 172.21.15.112:0/3073200617 learned_addr learned my addr 172.21.15.112:0/3073200617 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:03.753 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644b59e700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 0x7f644c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644a59c700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f644c066110 0x7f644c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 -- 172.21.15.112:0/3073200617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f644c066110 msgr2=0x7f644c14d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f644c066110 0x7f644c14d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 -- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 msgr2=0x7f644c14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:03.754 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 0x7f644c14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:03.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 -- 172.21.15.112:0/3073200617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c160880 con 0x7f644c065d30 2020-11-20T11:18:03.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644b59e700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 0x7f644c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:03.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f644ad9d700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f643c0096e0 tx=0x7f643c006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.740+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0113f0 con 0x7f644c065d30 2020-11-20T11:18:03.755 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.741+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c011570 con 0x7f644c065d30 2020-11-20T11:18:03.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.741+0000 7f645119d700 1 -- 172.21.15.112:0/3073200617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c160b20 con 0x7f644c065d30 2020-11-20T11:18:03.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.741+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011930 con 0x7f644c065d30 2020-11-20T11:18:03.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.741+0000 7f645119d700 1 -- 172.21.15.112:0/3073200617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c161060 con 0x7f644c065d30 2020-11-20T11:18:03.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.741+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c004fd0 con 0x7f644c065d30 2020-11-20T11:18:03.756 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.742+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f643c011ca0 con 0x7f644c065d30 2020-11-20T11:18:03.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.743+0000 7f6432ffd700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 0x7f6428082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:03.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.743+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f643c0a1fa0 con 0x7f644c065d30 2020-11-20T11:18:03.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.743+0000 7f644a59c700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 0x7f6428082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:03.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.743+0000 7f644a59c700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 0x7f6428082b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6440007fd0 tx=0x7f6440009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:03.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.746+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f643c0769b0 con 0x7f644c065d30 2020-11-20T11:18:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:03.931+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f641c0016a0 con 0x7f644c065d30 2020-11-20T11:18:04.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.062+0000 7f6432ffd700 1 -- 172.21.15.112:0/3073200617 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f643c079fd0 con 0x7f644c065d30 2020-11-20T11:18:04.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 msgr2=0x7f6428082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 0x7f6428082b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6440007fd0 tx=0x7f6440009040).stop 2020-11-20T11:18:04.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 msgr2=0x7f644c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f643c0096e0 tx=0x7f643c006d90).stop 2020-11-20T11:18:04.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 shutdown_connections 2020-11-20T11:18:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6428080670 0x7f6428082b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f644c1519f0 0x7f644c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c065d30 0x7f644c14e700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 --2- 172.21.15.112:0/3073200617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f644c066110 0x7f644c14d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.063+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 >> 172.21.15.112:0/3073200617 conn(0x7f644c05bac0 msgr2=0x7f644c0c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:04.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.064+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 shutdown_connections 2020-11-20T11:18:04.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.064+0000 7f6430ff9700 1 -- 172.21.15.112:0/3073200617 wait complete. 2020-11-20T11:18:04.078 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T11:18:04.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.191+0000 7fc474983700 1 Processor -- start 2020-11-20T11:18:04.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.191+0000 7fc474983700 1 -- start start 2020-11-20T11:18:04.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.192+0000 7fc474983700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4700c5830 0x7fc4700c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:04.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.192+0000 7fc474983700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc470150230 con 0x7fc4700c1fa0 2020-11-20T11:18:04.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.192+0000 7fc474983700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700c2700 con 0x7fc4700bb580 2020-11-20T11:18:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.192+0000 7fc474983700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700c29a0 con 0x7fc4700c5830 2020-11-20T11:18:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4700c5830 0x7fc4700c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46ffff700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc4700bb580 0x7fc4700bba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:44842/0 (socket says 172.21.15.112:44842) 2020-11-20T11:18:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4700c5830 0x7fc4700c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:36298/0 (socket says 172.21.15.112:36298) 2020-11-20T11:18:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46ffff700 1 -- 172.21.15.112:0/1868216651 learned_addr learned my addr 172.21.15.112:0/1868216651 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46effd700 1 --1- 172.21.15.112:0/1868216651 >> v1:172.21.15.166:6789/0 conn(0x7fc4700c1fa0 0x7fc4700bd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45372/0 (socket says 172.21.15.112:45372) 2020-11-20T11:18:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46e7fc700 1 -- 172.21.15.112:0/1868216651 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979119035 0 0) 0x7fc470150230 con 0x7fc4700c1fa0 2020-11-20T11:18:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46e7fc700 1 -- 172.21.15.112:0/1868216651 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc45c003280 con 0x7fc4700c1fa0 2020-11-20T11:18:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 -- 172.21.15.112:0/1868216651 >> v1:172.21.15.204:6789/0 conn(0x7fc4700bb580 legacy=0x7fc4700bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 -- 172.21.15.112:0/1868216651 >> v1:172.21.15.166:6789/0 conn(0x7fc4700c1fa0 legacy=0x7fc4700bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 -- 172.21.15.112:0/1868216651 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700c2c40 con 0x7fc4700c5830 2020-11-20T11:18:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46f7fe700 1 --2- 172.21.15.112:0/1868216651 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700c5830 0x7fc4700c5c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc460006fd0 tx=0x7fc460006e30).ready entity=mon.2 client_cookie=f9a1894451f38d7f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46e7fc700 1 -- 172.21.15.112:0/1868216651 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600097e0 con 0x7fc4700c5830 2020-11-20T11:18:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46e7fc700 1 -- 172.21.15.112:0/1868216651 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460000e90 con 0x7fc4700c5830 2020-11-20T11:18:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.193+0000 7fc46e7fc700 1 -- 172.21.15.112:0/1868216651 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460009b50 con 0x7fc4700c5830 2020-11-20T11:18:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 -- 172.21.15.112:0/1868216651 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700c5830 msgr2=0x7fc4700c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 --2- 172.21.15.112:0/1868216651 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700c5830 0x7fc4700c5c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc460006fd0 tx=0x7fc460006e30).stop 2020-11-20T11:18:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 -- 172.21.15.112:0/1868216651 shutdown_connections 2020-11-20T11:18:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 --2- 172.21.15.112:0/1868216651 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700c5830 0x7fc4700c5c10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 -- 172.21.15.112:0/1868216651 >> 172.21.15.112:0/1868216651 conn(0x7fc4700639a0 msgr2=0x7fc47005bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 -- 172.21.15.112:0/1868216651 shutdown_connections 2020-11-20T11:18:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.194+0000 7fc474983700 1 -- 172.21.15.112:0/1868216651 wait complete. 2020-11-20T11:18:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.195+0000 7fc474983700 1 Processor -- start 2020-11-20T11:18:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.195+0000 7fc474983700 1 -- start start 2020-11-20T11:18:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700bb580 0x7fc4701623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc4700c1fa0 0x7fc4701509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701628b0 con 0x7fc4700c5830 2020-11-20T11:18:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47015f8b0 con 0x7fc4700c1fa0 2020-11-20T11:18:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470110e60 con 0x7fc4700bb580 2020-11-20T11:18:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50530/0 (socket says 172.21.15.112:50530) 2020-11-20T11:18:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 -- 172.21.15.112:0/4290179057 learned_addr learned my addr 172.21.15.112:0/4290179057 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46effd700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc4700c1fa0 0x7fc4701509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46f7fe700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700bb580 0x7fc4701623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 -- 172.21.15.112:0/4290179057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700bb580 msgr2=0x7fc4701623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700bb580 0x7fc4701623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 -- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc4700c1fa0 msgr2=0x7fc4701509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc4700c1fa0 0x7fc4701509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 -- 172.21.15.112:0/4290179057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4701110c0 con 0x7fc4700c5830 2020-11-20T11:18:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc46ffff700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc46800ca90 tx=0x7fc46800cda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680020e0 con 0x7fc4700c5830 2020-11-20T11:18:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468005bc0 con 0x7fc4700c5830 2020-11-20T11:18:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470111360 con 0x7fc4700c5830 2020-11-20T11:18:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.196+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468007110 con 0x7fc4700c5830 2020-11-20T11:18:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.197+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47015fae0 con 0x7fc4700c5830 2020-11-20T11:18:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.197+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4700008d0 con 0x7fc4700c5830 2020-11-20T11:18:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.198+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc468010030 con 0x7fc4700c5830 2020-11-20T11:18:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.198+0000 7fc4577fe700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 0x7fc44c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.199+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc4680a3120 con 0x7fc4700c5830 2020-11-20T11:18:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.199+0000 7fc46f7fe700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 0x7fc44c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.199+0000 7fc46f7fe700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 0x7fc44c082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc460009fd0 tx=0x7fc460015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.201+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc468077b30 con 0x7fc4700c5830 2020-11-20T11:18:04.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:04.386+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fc4700656c0 con 0x7fc4700c5830 2020-11-20T11:18:05.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.066+0000 7fc4577fe700 1 -- 172.21.15.112:0/4290179057 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v6) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc46807b150 con 0x7fc4700c5830 2020-11-20T11:18:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 msgr2=0x7fc44c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 0x7fc44c082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc460009fd0 tx=0x7fc460015000).stop 2020-11-20T11:18:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 msgr2=0x7fc4700c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc46800ca90 tx=0x7fc46800cda0).stop 2020-11-20T11:18:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 shutdown_connections 2020-11-20T11:18:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc44c080670 0x7fc44c082b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4700c5830 0x7fc4700c41c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4700bb580 0x7fc4701623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 --2- 172.21.15.112:0/4290179057 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc4700c1fa0 0x7fc4701509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 >> 172.21.15.112:0/4290179057 conn(0x7fc4700639a0 msgr2=0x7fc4700c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 shutdown_connections 2020-11-20T11:18:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.068+0000 7fc474983700 1 -- 172.21.15.112:0/4290179057 wait complete. 2020-11-20T11:18:05.084 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:18:05.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.197+0000 7f4d60098700 1 Processor -- start 2020-11-20T11:18:05.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.197+0000 7f4d60098700 1 -- start start 2020-11-20T11:18:05.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d60098700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4d581519f0 0x7f4d580bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d60098700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d580c5230 con 0x7f4d58066110 2020-11-20T11:18:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d60098700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d581549c0 con 0x7f4d58065d30 2020-11-20T11:18:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d60098700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d580bff40 con 0x7f4d581519f0 2020-11-20T11:18:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5d633700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4d58066110 0x7f4d581512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34728/0 (socket says 172.21.15.112:34728) 2020-11-20T11:18:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5d633700 1 -- 172.21.15.112:0/1308277856 learned_addr learned my addr 172.21.15.112:0/1308277856 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5e635700 1 --2- 172.21.15.112:0/1308277856 >> v2:172.21.15.204:3300/0 conn(0x7f4d581519f0 0x7f4d580bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192270691 0 0) 0x7f4d580c5230 con 0x7f4d58066110 2020-11-20T11:18:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003280 con 0x7f4d58066110 2020-11-20T11:18:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721846213 0 0) 0x7f4d581549c0 con 0x7f4d58065d30 2020-11-20T11:18:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d580c5230 con 0x7f4d58065d30 2020-11-20T11:18:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2866895109 0 0) 0x7f4d40003280 con 0x7f4d58066110 2020-11-20T11:18:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 >> v2:172.21.15.204:3300/0 conn(0x7f4d581519f0 msgr2=0x7f4d580bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 --2- 172.21.15.112:0/1308277856 >> v2:172.21.15.204:3300/0 conn(0x7f4d581519f0 0x7f4d580bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 >> v1:172.21.15.166:6789/0 conn(0x7f4d58065d30 legacy=0x7f4d580c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58154c60 con 0x7f4d58066110 2020-11-20T11:18:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f4d48001520 con 0x7f4d58066110 2020-11-20T11:18:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 >> v1:172.21.15.112:6789/0 conn(0x7f4d58066110 legacy=0x7f4d581512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 0x7f4d40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d40004520 0x7f4d400049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d40004e90 0x7f4d4000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580bff40 con 0x7f4d400039a0 2020-11-20T11:18:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000bc60 con 0x7f4d40004e90 2020-11-20T11:18:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.198+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000be20 con 0x7f4d40004520 2020-11-20T11:18:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 0x7f4d40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5d633700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d40004520 0x7f4d400049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5e635700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d40004e90 0x7f4d4000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 -- 172.21.15.112:0/1308277856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d40004520 msgr2=0x7f4d400049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:05.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d40004520 0x7f4d400049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 -- 172.21.15.112:0/1308277856 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d40004e90 msgr2=0x7f4d4000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:05.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d40004e90 0x7f4d4000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 -- 172.21.15.112:0/1308277856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40003280 con 0x7f4d400039a0 2020-11-20T11:18:05.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5e635700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d40004e90 0x7f4d4000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:05.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5e635700 1 -- 172.21.15.112:0/1308277856 reap_dead start 2020-11-20T11:18:05.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 0x7f4d40003da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d54001ac0 tx=0x7f4d54007bd0).ready entity=mon.0 client_cookie=cf2c08946b21dd6c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54007020 con 0x7f4d400039a0 2020-11-20T11:18:05.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54007180 con 0x7f4d400039a0 2020-11-20T11:18:05.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.199+0000 7f4d5ce32700 1 -- 172.21.15.112:0/1308277856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400c800 con 0x7f4d400039a0 2020-11-20T11:18:05.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 -- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 msgr2=0x7f4d40003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 0x7f4d40003da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4d54001ac0 tx=0x7f4d54007bd0).stop 2020-11-20T11:18:05.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 -- 172.21.15.112:0/1308277856 shutdown_connections 2020-11-20T11:18:05.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 --2- 172.21.15.112:0/1308277856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d400039a0 0x7f4d40003da0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 -- 172.21.15.112:0/1308277856 >> 172.21.15.112:0/1308277856 conn(0x7f4d5805bac0 msgr2=0x7f4d5805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 -- 172.21.15.112:0/1308277856 shutdown_connections 2020-11-20T11:18:05.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.200+0000 7f4d60098700 1 -- 172.21.15.112:0/1308277856 wait complete. 2020-11-20T11:18:05.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 Processor -- start 2020-11-20T11:18:05.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 -- start start 2020-11-20T11:18:05.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 0x7f4d5814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d580c0390 0x7f4d580c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580c3260 con 0x7f4d580c2e00 2020-11-20T11:18:05.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5814b8d0 con 0x7f4d400039a0 2020-11-20T11:18:05.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.201+0000 7f4d60098700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5814bb70 con 0x7f4d580c0390 2020-11-20T11:18:05.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50548/0 (socket says 172.21.15.112:50548) 2020-11-20T11:18:05.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 -- 172.21.15.112:0/1319134849 learned_addr learned my addr 172.21.15.112:0/1319134849 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:05.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5e635700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d580c0390 0x7f4d580c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 0x7f4d5814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 -- 172.21.15.112:0/1319134849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d580c0390 msgr2=0x7f4d580c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d580c0390 0x7f4d580c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 -- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 msgr2=0x7f4d5814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 0x7f4d5814ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 -- 172.21.15.112:0/1319134849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5814be10 con 0x7f4d580c2e00 2020-11-20T11:18:05.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 0x7f4d5814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:05.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d5d633700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d48004b20 tx=0x7f4d58154df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800f8d0 con 0x7f4d580c2e00 2020-11-20T11:18:05.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800fa30 con 0x7f4d580c2e00 2020-11-20T11:18:05.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800fdd0 con 0x7f4d580c2e00 2020-11-20T11:18:05.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5814c0b0 con 0x7f4d580c2e00 2020-11-20T11:18:05.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.202+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5814c7f0 con 0x7f4d580c2e00 2020-11-20T11:18:05.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.203+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d580c8870 con 0x7f4d580c2e00 2020-11-20T11:18:05.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.204+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4d48012560 con 0x7f4d580c2e00 2020-11-20T11:18:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.204+0000 7f4d45ffb700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 0x7f4d30082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.204+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4d480a2030 con 0x7f4d580c2e00 2020-11-20T11:18:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.204+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 0x7f4d30082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.205+0000 7f4d5de34700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 0x7f4d30082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4d54000c00 tx=0x7f4d54016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.207+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4d480769e0 con 0x7f4d580c2e00 2020-11-20T11:18:05.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.391+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5814c510 con 0x7f4d580c2e00 2020-11-20T11:18:05.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.392+0000 7f4d45ffb700 1 -- 172.21.15.112:0/1319134849 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2492 (secure 0 0 0) 0x7f4d480199d0 con 0x7f4d580c2e00 2020-11-20T11:18:05.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 msgr2=0x7f4d30082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 0x7f4d30082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4d54000c00 tx=0x7f4d54016000).stop 2020-11-20T11:18:05.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 msgr2=0x7f4d580c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d48004b20 tx=0x7f4d58154df0).stop 2020-11-20T11:18:05.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 shutdown_connections 2020-11-20T11:18:05.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4d30080670 0x7f4d30082b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d580c0390 0x7f4d580c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4d400039a0 0x7f4d5814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 --2- 172.21.15.112:0/1319134849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d580c2e00 0x7f4d580c8380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 >> 172.21.15.112:0/1319134849 conn(0x7f4d5805bac0 msgr2=0x7f4d580649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 shutdown_connections 2020-11-20T11:18:05.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.393+0000 7f4d60098700 1 -- 172.21.15.112:0/1319134849 wait complete. 2020-11-20T11:18:05.409 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 6 2020-11-20T11:18:05.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:05.409 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.166:6835/1658784600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6834","nonce":1658784600},{"type":"v1","addr":"172.21.15.166:6835","nonce":1658784600}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1046289868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1046289868},{"type":"v1","addr":"172.21.15.204:6833","nonce":1046289868}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:18:03.056969+0000","modified":"2020-11-20T11:18:05.061626+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6833/1222289625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1222289625},{"type":"v1","addr":"172.21.15.112:6833","nonce":1222289625}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:18:05.411 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:05.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.520+0000 7f6401d74700 1 Processor -- start 2020-11-20T11:18:05.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 -- start start 2020-11-20T11:18:05.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63fc0bdc70 0x7f63fc0be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63fc0646b0 0x7f63fc064b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0c3180 con 0x7f63fc0c21b0 2020-11-20T11:18:05.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc14f5c0 con 0x7f63fc0646b0 2020-11-20T11:18:05.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f6401d74700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc14f860 con 0x7f63fc0bdc70 2020-11-20T11:18:05.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.521+0000 7f63faffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63fc0646b0 0x7f63fc064b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63fc0646b0 0x7f63fc064b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50558/0 (socket says 172.21.15.112:50558) 2020-11-20T11:18:05.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 -- 172.21.15.112:0/901516734 learned_addr learned my addr 172.21.15.112:0/901516734 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:05.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63fb7fe700 1 --2- 172.21.15.112:0/901516734 >> v2:172.21.15.204:3300/0 conn(0x7f63fc0bdc70 0x7f63fc0be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 -- 172.21.15.112:0/901516734 >> v2:172.21.15.204:3300/0 conn(0x7f63fc0bdc70 msgr2=0x7f63fc0be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:05.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 --2- 172.21.15.112:0/901516734 >> v2:172.21.15.204:3300/0 conn(0x7f63fc0bdc70 0x7f63fc0be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 -- 172.21.15.112:0/901516734 >> v1:172.21.15.166:6789/0 conn(0x7f63fc0c21b0 legacy=0x7f63fc0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:05.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 -- 172.21.15.112:0/901516734 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc14fb00 con 0x7f63fc0646b0 2020-11-20T11:18:05.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63faffd700 1 --2- 172.21.15.112:0/901516734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0646b0 0x7f63fc064b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f63fc0c3370 tx=0x7f63f0006ef0).ready entity=mon.0 client_cookie=2b29ce245e92f3a0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63fa7fc700 1 -- 172.21.15.112:0/901516734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000b820 con 0x7f63fc0646b0 2020-11-20T11:18:05.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63fa7fc700 1 -- 172.21.15.112:0/901516734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0000e90 con 0x7f63fc0646b0 2020-11-20T11:18:05.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f63fa7fc700 1 -- 172.21.15.112:0/901516734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000bb90 con 0x7f63fc0646b0 2020-11-20T11:18:05.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f6401d74700 1 -- 172.21.15.112:0/901516734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0646b0 msgr2=0x7f63fc064b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f6401d74700 1 --2- 172.21.15.112:0/901516734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0646b0 0x7f63fc064b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f63fc0c3370 tx=0x7f63f0006ef0).stop 2020-11-20T11:18:05.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f6401d74700 1 -- 172.21.15.112:0/901516734 shutdown_connections 2020-11-20T11:18:05.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f6401d74700 1 --2- 172.21.15.112:0/901516734 >> v2:172.21.15.204:3300/0 conn(0x7f63fc0bdc70 0x7f63fc0be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.522+0000 7f6401d74700 1 --2- 172.21.15.112:0/901516734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0646b0 0x7f63fc064b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.523+0000 7f6401d74700 1 -- 172.21.15.112:0/901516734 >> 172.21.15.112:0/901516734 conn(0x7f63fc0bbc50 msgr2=0x7f63fc0bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.523+0000 7f6401d74700 1 -- 172.21.15.112:0/901516734 shutdown_connections 2020-11-20T11:18:05.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.523+0000 7f6401d74700 1 -- 172.21.15.112:0/901516734 wait complete. 2020-11-20T11:18:05.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.524+0000 7f6401d74700 1 Processor -- start 2020-11-20T11:18:05.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.524+0000 7f6401d74700 1 -- start start 2020-11-20T11:18:05.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.524+0000 7f6401d74700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f63fc0646b0 0x7f63fc146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0c21b0 0x7f63fc141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1436a0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1472f0 con 0x7f63fc0646b0 2020-11-20T11:18:05.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0c4970 con 0x7f63fc0c21b0 2020-11-20T11:18:05.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50562/0 (socket says 172.21.15.112:50562) 2020-11-20T11:18:05.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 -- 172.21.15.112:0/1508029260 learned_addr learned my addr 172.21.15.112:0/1508029260 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:05.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63fb7fe700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f63fc0646b0 0x7f63fc146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 -- 172.21.15.112:0/1508029260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0c21b0 msgr2=0x7f63fc141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63fbfff700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0c21b0 0x7f63fc141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0c21b0 0x7f63fc141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 -- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f63fc0646b0 msgr2=0x7f63fc146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f63fc0646b0 0x7f63fc146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 -- 172.21.15.112:0/1508029260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0c4c10 con 0x7f63fc0bdc70 2020-11-20T11:18:05.549 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63faffd700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f63f0011000 tx=0x7f63f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.549 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f001d480 con 0x7f63fc0bdc70 2020-11-20T11:18:05.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f001d5e0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc0c4eb0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f001d980 con 0x7f63fc0bdc70 2020-11-20T11:18:05.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.525+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc0c53f0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.526+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc064490 con 0x7f63fc0bdc70 2020-11-20T11:18:05.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.527+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f63f0017070 con 0x7f63fc0bdc70 2020-11-20T11:18:05.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.527+0000 7f63db7fe700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 0x7f63d4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.527+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f63f00a48a0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.527+0000 7f63fb7fe700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 0x7f63d4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.528+0000 7f63fb7fe700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 0x7f63d4082b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f63ec00b9b0 tx=0x7f63ec008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.531+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f63f00792b0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.674 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.671+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63fc0666c0 con 0x7f63fc0bdc70 2020-11-20T11:18:05.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.672+0000 7f63db7fe700 1 -- 172.21.15.112:0/1508029260 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f63f0015030 con 0x7f63fc0bdc70 2020-11-20T11:18:05.675 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:05.675 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:05.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 msgr2=0x7f63d4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 0x7f63d4082b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f63ec00b9b0 tx=0x7f63ec008040).stop 2020-11-20T11:18:05.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 msgr2=0x7f63fc141710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f63f0011000 tx=0x7f63f0016000).stop 2020-11-20T11:18:05.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 shutdown_connections 2020-11-20T11:18:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f63d40806a0 0x7f63d4082b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0c21b0 0x7f63fc141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f63fc0646b0 0x7f63fc146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 --2- 172.21.15.112:0/1508029260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63fc0bdc70 0x7f63fc141710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 >> 172.21.15.112:0/1508029260 conn(0x7f63fc0bbc50 msgr2=0x7f63fc14e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 shutdown_connections 2020-11-20T11:18:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.673+0000 7f6401d74700 1 -- 172.21.15.112:0/1508029260 wait complete. 2020-11-20T11:18:05.688 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:05.689 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T11:18:05.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 Processor -- start 2020-11-20T11:18:05.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 -- start start 2020-11-20T11:18:05.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fd72c065d30 0x7fd72c066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c0c5230 con 0x7fd72c0bfa50 2020-11-20T11:18:05.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c1549c0 con 0x7fd72c1512e0 2020-11-20T11:18:05.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.797+0000 7fd731429700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c154c60 con 0x7fd72c065d30 2020-11-20T11:18:05.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fd72c065d30 0x7fd72c066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd723fff700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7fd72c0bfa50 0x7fd72c0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45416/0 (socket says 172.21.15.112:45416) 2020-11-20T11:18:05.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fd72c065d30 0x7fd72c066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:38564/0 (socket says 172.21.15.112:38564) 2020-11-20T11:18:05.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd723fff700 1 -- 172.21.15.112:0/1309612213 learned_addr learned my addr 172.21.15.112:0/1309612213 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 -- 172.21.15.112:0/1309612213 >> v1:172.21.15.204:6789/0 conn(0x7fd72c1512e0 legacy=0x7fd72c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 -- 172.21.15.112:0/1309612213 >> v1:172.21.15.166:6789/0 conn(0x7fd72c0bfa50 legacy=0x7fd72c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72a7fc700 1 -- 172.21.15.112:0/1309612213 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010999920 0 0) 0x7fd72c1549c0 con 0x7fd72c1512e0 2020-11-20T11:18:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 -- 172.21.15.112:0/1309612213 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c154f00 con 0x7fd72c065d30 2020-11-20T11:18:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72affd700 1 --2- 172.21.15.112:0/1309612213 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c066110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd71c006fd0 tx=0x7fd71c006e30).ready entity=mon.1 client_cookie=f2a862fbcf575be3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72a7fc700 1 -- 172.21.15.112:0/1309612213 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0097e0 con 0x7fd72c065d30 2020-11-20T11:18:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72a7fc700 1 -- 172.21.15.112:0/1309612213 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c000e90 con 0x7fd72c065d30 2020-11-20T11:18:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.798+0000 7fd72a7fc700 1 -- 172.21.15.112:0/1309612213 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c009b50 con 0x7fd72c065d30 2020-11-20T11:18:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 -- 172.21.15.112:0/1309612213 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 msgr2=0x7fd72c066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 --2- 172.21.15.112:0/1309612213 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c066110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd71c006fd0 tx=0x7fd71c006e30).stop 2020-11-20T11:18:05.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 -- 172.21.15.112:0/1309612213 shutdown_connections 2020-11-20T11:18:05.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 --2- 172.21.15.112:0/1309612213 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c066110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 -- 172.21.15.112:0/1309612213 >> 172.21.15.112:0/1309612213 conn(0x7fd72c05bac0 msgr2=0x7fd72c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 -- 172.21.15.112:0/1309612213 shutdown_connections 2020-11-20T11:18:05.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.799+0000 7fd731429700 1 -- 172.21.15.112:0/1309612213 wait complete. 2020-11-20T11:18:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.800+0000 7fd731429700 1 Processor -- start 2020-11-20T11:18:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.800+0000 7fd731429700 1 -- start start 2020-11-20T11:18:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd72c0bfa50 0x7fd72c158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c160d90 con 0x7fd72c1512e0 2020-11-20T11:18:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c161030 con 0x7fd72c065d30 2020-11-20T11:18:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1612d0 con 0x7fd72c0bfa50 2020-11-20T11:18:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50578/0 (socket says 172.21.15.112:50578) 2020-11-20T11:18:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 -- 172.21.15.112:0/3445946541 learned_addr learned my addr 172.21.15.112:0/3445946541 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72affd700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd723fff700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd72c0bfa50 0x7fd72c158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 -- 172.21.15.112:0/3445946541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd72c0bfa50 msgr2=0x7fd72c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd72c0bfa50 0x7fd72c158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 -- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 msgr2=0x7fd72c14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c14bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 -- 172.21.15.112:0/3445946541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c161570 con 0x7fd72c1512e0 2020-11-20T11:18:05.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd72b7fe700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd72400cab0 tx=0x7fd724001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724003110 con 0x7fd72c1512e0 2020-11-20T11:18:05.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400a7a0 con 0x7fd72c1512e0 2020-11-20T11:18:05.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c161810 con 0x7fd72c1512e0 2020-11-20T11:18:05.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400ab40 con 0x7fd72c1512e0 2020-11-20T11:18:05.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.801+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c160a20 con 0x7fd72c1512e0 2020-11-20T11:18:05.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.802+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c149400 con 0x7fd72c1512e0 2020-11-20T11:18:05.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.803+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd724019030 con 0x7fd72c1512e0 2020-11-20T11:18:05.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.803+0000 7fd722ffd700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 0x7fd708082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:05.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.803+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd7240a2490 con 0x7fd72c1512e0 2020-11-20T11:18:05.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.804+0000 7fd72affd700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 0x7fd708082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:05.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.804+0000 7fd72affd700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 0x7fd708082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd71c00b150 tx=0x7fd71c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:05.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.807+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd724076ea0 con 0x7fd72c1512e0 2020-11-20T11:18:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.948+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd72c0c1ba0 con 0x7fd72c1512e0 2020-11-20T11:18:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.949+0000 7fd722ffd700 1 -- 172.21.15.112:0/3445946541 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7fd72407a4c0 con 0x7fd72c1512e0 2020-11-20T11:18:05.953 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:05.953 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:05.954 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 msgr2=0x7fd708082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 0x7fd708082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd71c00b150 tx=0x7fd71c015000).stop 2020-11-20T11:18:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 msgr2=0x7fd72c1484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd72400cab0 tx=0x7fd724001360).stop 2020-11-20T11:18:05.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 shutdown_connections 2020-11-20T11:18:05.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd708080670 0x7fd708082b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1512e0 0x7fd72c1484e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd72c065d30 0x7fd72c14bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 --2- 172.21.15.112:0/3445946541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd72c0bfa50 0x7fd72c158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:05.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 >> 172.21.15.112:0/3445946541 conn(0x7fd72c05bac0 msgr2=0x7fd72c153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:05.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 shutdown_connections 2020-11-20T11:18:05.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:05.951+0000 7fd731429700 1 -- 172.21.15.112:0/3445946541 wait complete. 2020-11-20T11:18:05.967 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:17:46.086314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:17:55.502772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:17:58.012089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:18:00.733600+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:18:05.968 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:18:06.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.076+0000 7fd39c50c700 1 Processor -- start 2020-11-20T11:18:06.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.076+0000 7fd39c50c700 1 -- start start 2020-11-20T11:18:06.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.077+0000 7fd39c50c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39414d8a0 con 0x7fd39414af80 2020-11-20T11:18:06.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.077+0000 7fd39c50c700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd394151110 con 0x7fd394064b90 2020-11-20T11:18:06.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.077+0000 7fd39c50c700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3941513b0 con 0x7fd394060f10 2020-11-20T11:18:06.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd39aaa9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd39414af80 0x7fd39414dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34780/0 (socket says 172.21.15.112:34780) 2020-11-20T11:18:06.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd39aaa9700 1 -- 172.21.15.112:0/2835122565 learned_addr learned my addr 172.21.15.112:0/2835122565 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:06.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288213675 0 0) 0x7fd39414d8a0 con 0x7fd39414af80 2020-11-20T11:18:06.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c003280 con 0x7fd39414af80 2020-11-20T11:18:06.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151583803 0 0) 0x7fd394151110 con 0x7fd394064b90 2020-11-20T11:18:06.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39414d8a0 con 0x7fd394064b90 2020-11-20T11:18:06.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3161612554 0 0) 0x7fd37c003280 con 0x7fd39414af80 2020-11-20T11:18:06.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 >> v1:172.21.15.204:6789/0 conn(0x7fd394060f10 legacy=0x7fd39414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 >> v1:172.21.15.166:6789/0 conn(0x7fd394064b90 legacy=0x7fd3940bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394151650 con 0x7fd39414af80 2020-11-20T11:18:06.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fd38c0018a0 con 0x7fd39414af80 2020-11-20T11:18:06.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 >> v1:172.21.15.112:6789/0 conn(0x7fd39414af80 legacy=0x7fd39414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 0x7fd37c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd37c004520 0x7fd37c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c004e90 0x7fd37c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00bc60 con 0x7fd37c003930 2020-11-20T11:18:06.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00bda0 con 0x7fd37c004520 2020-11-20T11:18:06.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00cff0 con 0x7fd37c004e90 2020-11-20T11:18:06.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 0x7fd37c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.078+0000 7fd399aa7700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd37c004520 0x7fd37c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39aaa9700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c004e90 0x7fd37c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 -- 172.21.15.112:0/2835122565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c004e90 msgr2=0x7fd37c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:06.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c004e90 0x7fd37c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 -- 172.21.15.112:0/2835122565 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd37c004520 msgr2=0x7fd37c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:06.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd37c004520 0x7fd37c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 -- 172.21.15.112:0/2835122565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c003280 con 0x7fd37c003930 2020-11-20T11:18:06.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39aaa9700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c004e90 0x7fd37c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:06.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39aaa9700 1 -- 172.21.15.112:0/2835122565 reap_dead start 2020-11-20T11:18:06.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 0x7fd37c003d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd390001af0 tx=0x7fd390007bb0).ready entity=mon.0 client_cookie=9481f504edf4c652 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000c830 con 0x7fd37c003930 2020-11-20T11:18:06.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39000c990 con 0x7fd37c003930 2020-11-20T11:18:06.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd3992a6700 1 -- 172.21.15.112:0/2835122565 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000cd50 con 0x7fd37c003930 2020-11-20T11:18:06.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 -- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 msgr2=0x7fd37c003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 0x7fd37c003d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd390001af0 tx=0x7fd390007bb0).stop 2020-11-20T11:18:06.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 -- 172.21.15.112:0/2835122565 shutdown_connections 2020-11-20T11:18:06.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 --2- 172.21.15.112:0/2835122565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd37c003930 0x7fd37c003d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 -- 172.21.15.112:0/2835122565 >> 172.21.15.112:0/2835122565 conn(0x7fd39405bac0 msgr2=0x7fd39405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 -- 172.21.15.112:0/2835122565 shutdown_connections 2020-11-20T11:18:06.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.079+0000 7fd39c50c700 1 -- 172.21.15.112:0/2835122565 wait complete. 2020-11-20T11:18:06.097 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.080+0000 7fd39c50c700 1 Processor -- start 2020-11-20T11:18:06.097 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 -- start start 2020-11-20T11:18:06.097 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c003930 0x7fd394149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.097 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd394161570 0x7fd39415e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394161ce0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394161f80 con 0x7fd394161570 2020-11-20T11:18:06.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39c50c700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394162220 con 0x7fd37c003930 2020-11-20T11:18:06.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39aaa9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39aaa9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50596/0 (socket says 172.21.15.112:50596) 2020-11-20T11:18:06.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.081+0000 7fd39aaa9700 1 -- 172.21.15.112:0/3603527798 learned_addr learned my addr 172.21.15.112:0/3603527798 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:06.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c003930 0x7fd394149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd399aa7700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd394161570 0x7fd39415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 -- 172.21.15.112:0/3603527798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c003930 msgr2=0x7fd394149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c003930 0x7fd394149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 -- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd394161570 msgr2=0x7fd39415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd394161570 0x7fd39415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 -- 172.21.15.112:0/3603527798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39415e210 con 0x7fd3940bf6a0 2020-11-20T11:18:06.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39aaa9700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd38c0012e0 tx=0x7fd3941517e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00e8f0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00ea50 con 0x7fd3940bf6a0 2020-11-20T11:18:06.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39415e4b0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00ee10 con 0x7fd3940bf6a0 2020-11-20T11:18:06.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.082+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39415ee40 con 0x7fd3940bf6a0 2020-11-20T11:18:06.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.083+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3941623e0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.083+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd38c0133e0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.084+0000 7fd3827fc700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 0x7fd36c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.084+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd38c0a2760 con 0x7fd3940bf6a0 2020-11-20T11:18:06.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.084+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 0x7fd36c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.084+0000 7fd39a2a8700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 0x7fd36c082b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd390000c00 tx=0x7fd390017000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.088+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd38c077110 con 0x7fd3940bf6a0 2020-11-20T11:18:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.227+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd3940666e0 con 0x7fd3940bf6a0 2020-11-20T11:18:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.228+0000 7fd3827fc700 1 -- 172.21.15.112:0/3603527798 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd38c07a730 con 0x7fd3940bf6a0 2020-11-20T11:18:06.231 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2020-11-20T11:18:06.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 msgr2=0x7fd36c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 0x7fd36c082b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd390000c00 tx=0x7fd390017000).stop 2020-11-20T11:18:06.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 msgr2=0x7fd39414c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd38c0012e0 tx=0x7fd3941517e0).stop 2020-11-20T11:18:06.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 shutdown_connections 2020-11-20T11:18:06.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd36c0806a0 0x7fd36c082b60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3940bf6a0 0x7fd39414c6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd37c003930 0x7fd394149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.229+0000 7fd39c50c700 1 --2- 172.21.15.112:0/3603527798 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd394161570 0x7fd39415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.230+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 >> 172.21.15.112:0/3603527798 conn(0x7fd39405bac0 msgr2=0x7fd3941464d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.230+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 shutdown_connections 2020-11-20T11:18:06.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.230+0000 7fd39c50c700 1 -- 172.21.15.112:0/3603527798 wait complete. 2020-11-20T11:18:06.244 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:18:06.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.351+0000 7f154e2c9700 1 Processor -- start 2020-11-20T11:18:06.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.351+0000 7f154e2c9700 1 -- start start 2020-11-20T11:18:06.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f154e2c9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1548066110 0x7f15480bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f154e2c9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480c5230 con 0x7f15481512e0 2020-11-20T11:18:06.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f154e2c9700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15481549c0 con 0x7f1548065d30 2020-11-20T11:18:06.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f154e2c9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480bff40 con 0x7f1548066110 2020-11-20T11:18:06.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f15477fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1548066110 0x7f15480bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.358 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f15477fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1548066110 0x7f15480bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50606/0 (socket says 172.21.15.112:50606) 2020-11-20T11:18:06.358 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f154c866700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f15481512e0 0x7f1548151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34798/0 (socket says 172.21.15.112:34798) 2020-11-20T11:18:06.358 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.352+0000 7f15477fe700 1 -- 172.21.15.112:0/2707387371 learned_addr learned my addr 172.21.15.112:0/2707387371 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:06.358 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f15477fe700 1 -- 172.21.15.112:0/2707387371 >> v1:172.21.15.166:6789/0 conn(0x7f1548065d30 legacy=0x7f15480c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f15477fe700 1 -- 172.21.15.112:0/2707387371 >> v1:172.21.15.112:6789/0 conn(0x7f15481512e0 legacy=0x7f1548151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f1546ffd700 1 -- 172.21.15.112:0/2707387371 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116777863 0 0) 0x7f15480c5230 con 0x7f15481512e0 2020-11-20T11:18:06.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f15477fe700 1 -- 172.21.15.112:0/2707387371 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548154c60 con 0x7f1548066110 2020-11-20T11:18:06.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f15477fe700 1 --2- 172.21.15.112:0/2707387371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480bfa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f153c009a10 tx=0x7f153c006ef0).ready entity=mon.0 client_cookie=877d4ce4c8937e12 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f1546ffd700 1 -- 172.21.15.112:0/2707387371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c00b860 con 0x7f1548066110 2020-11-20T11:18:06.360 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f1546ffd700 1 -- 172.21.15.112:0/2707387371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c000e90 con 0x7f1548066110 2020-11-20T11:18:06.360 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f1546ffd700 1 -- 172.21.15.112:0/2707387371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c00bbd0 con 0x7f1548066110 2020-11-20T11:18:06.360 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f154e2c9700 1 -- 172.21.15.112:0/2707387371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 msgr2=0x7f15480bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.360 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f154e2c9700 1 --2- 172.21.15.112:0/2707387371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480bfa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f153c009a10 tx=0x7f153c006ef0).stop 2020-11-20T11:18:06.360 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f154e2c9700 1 -- 172.21.15.112:0/2707387371 shutdown_connections 2020-11-20T11:18:06.361 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f154e2c9700 1 --2- 172.21.15.112:0/2707387371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480bfa50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.361 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.353+0000 7f154e2c9700 1 -- 172.21.15.112:0/2707387371 >> 172.21.15.112:0/2707387371 conn(0x7f154805bac0 msgr2=0x7f154805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.363 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.354+0000 7f154e2c9700 1 -- 172.21.15.112:0/2707387371 shutdown_connections 2020-11-20T11:18:06.364 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.354+0000 7f154e2c9700 1 -- 172.21.15.112:0/2707387371 wait complete. 2020-11-20T11:18:06.367 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 Processor -- start 2020-11-20T11:18:06.367 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 -- start start 2020-11-20T11:18:06.368 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1548065d30 0x7f15481612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.368 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.368 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 0x7f154814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.368 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15481617e0 con 0x7f1548066110 2020-11-20T11:18:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548153140 con 0x7f1548065d30 2020-11-20T11:18:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.355+0000 7f154e2c9700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15481533e0 con 0x7f15481512e0 2020-11-20T11:18:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50610/0 (socket says 172.21.15.112:50610) 2020-11-20T11:18:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 -- 172.21.15.112:0/1463582707 learned_addr learned my addr 172.21.15.112:0/1463582707 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f1547fff700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1548065d30 0x7f15481612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f154c866700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 0x7f154814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 -- 172.21.15.112:0/1463582707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 msgr2=0x7f154814d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 0x7f154814d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 -- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1548065d30 msgr2=0x7f15481612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1548065d30 0x7f15481612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 -- 172.21.15.112:0/1463582707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548153680 con 0x7f1548066110 2020-11-20T11:18:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f154c866700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 0x7f154814d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f15477fe700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f153c00b3c0 tx=0x7f153c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011e80 con 0x7f1548066110 2020-11-20T11:18:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c01c440 con 0x7f1548066110 2020-11-20T11:18:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1548153920 con 0x7f1548066110 2020-11-20T11:18:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c01c7c0 con 0x7f1548066110 2020-11-20T11:18:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.356+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1548154560 con 0x7f1548066110 2020-11-20T11:18:06.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.357+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15480666e0 con 0x7f1548066110 2020-11-20T11:18:06.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.358+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f153c02c070 con 0x7f1548066110 2020-11-20T11:18:06.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.358+0000 7f1527fff700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 0x7f1520082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.358+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f153c0a4480 con 0x7f1548066110 2020-11-20T11:18:06.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.358+0000 7f1547fff700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 0x7f1520082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.359+0000 7f1547fff700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 0x7f1520082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1538007fd0 tx=0x7f1538007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.362+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f153c078e90 con 0x7f1548066110 2020-11-20T11:18:06.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.501+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1548065740 con 0x7f1548066110 2020-11-20T11:18:06.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.501+0000 7f1527fff700 1 -- 172.21.15.112:0/1463582707 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f153c0200a0 con 0x7f1548066110 2020-11-20T11:18:06.504 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:06.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 msgr2=0x7f1520082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 0x7f1520082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1538007fd0 tx=0x7f1538007bd0).stop 2020-11-20T11:18:06.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 msgr2=0x7f15480b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f153c00b3c0 tx=0x7f153c016000).stop 2020-11-20T11:18:06.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 shutdown_connections 2020-11-20T11:18:06.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15200806a0 0x7f1520082b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15481512e0 0x7f154814d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1548065d30 0x7f15481612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 --2- 172.21.15.112:0/1463582707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1548066110 0x7f15480b16c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 >> 172.21.15.112:0/1463582707 conn(0x7f154805bac0 msgr2=0x7f15480c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 shutdown_connections 2020-11-20T11:18:06.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.503+0000 7f154e2c9700 1 -- 172.21.15.112:0/1463582707 wait complete. 2020-11-20T11:18:06.517 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:18:06.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.626+0000 7f4499fc7700 1 Processor -- start 2020-11-20T11:18:06.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.626+0000 7f4499fc7700 1 -- start start 2020-11-20T11:18:06.636 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4499fc7700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4494066b60 0x7f4494066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4499fc7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494151490 con 0x7f44940bb8e0 2020-11-20T11:18:06.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4499fc7700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494064510 con 0x7f44941518f0 2020-11-20T11:18:06.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4499fc7700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4494063a90 con 0x7f4494066b60 2020-11-20T11:18:06.638 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4492ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f44940bb8e0 0x7f44940c16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34812/0 (socket says 172.21.15.112:34812) 2020-11-20T11:18:06.638 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f4492ffd700 1 -- 172.21.15.112:0/2190653722 learned_addr learned my addr 172.21.15.112:0/2190653722 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:06.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f44937fe700 1 --2- 172.21.15.112:0/2190653722 >> v2:172.21.15.204:3300/0 conn(0x7f4494066b60 0x7f4494066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845676380 0 0) 0x7f4494151490 con 0x7f44940bb8e0 2020-11-20T11:18:06.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.627+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003280 con 0x7f44940bb8e0 2020-11-20T11:18:06.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1147870788 0 0) 0x7f4480003280 con 0x7f44940bb8e0 2020-11-20T11:18:06.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 >> v2:172.21.15.204:3300/0 conn(0x7f4494066b60 msgr2=0x7f4494066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:06.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 --2- 172.21.15.112:0/2190653722 >> v2:172.21.15.204:3300/0 conn(0x7f4494066b60 0x7f4494066f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 >> v1:172.21.15.204:6789/0 conn(0x7f44941518f0 legacy=0x7f4494151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494063d30 con 0x7f44940bb8e0 2020-11-20T11:18:06.642 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f4488001520 con 0x7f44940bb8e0 2020-11-20T11:18:06.642 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 >> v1:172.21.15.112:6789/0 conn(0x7f44940bb8e0 legacy=0x7f44940c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.642 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f44800037c0 0x7f4480003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4480004520 0x7f44800049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f448000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494063a90 con 0x7f4480004e90 2020-11-20T11:18:06.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4480005370 con 0x7f44800037c0 2020-11-20T11:18:06.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448000bc60 con 0x7f4480004520 2020-11-20T11:18:06.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f448000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4492ffd700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4480004520 0x7f44800049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.646 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 -- 172.21.15.112:0/2190653722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4480004520 msgr2=0x7f44800049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:06.646 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4480004520 0x7f44800049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.646 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 -- 172.21.15.112:0/2190653722 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f44800037c0 msgr2=0x7f4480003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:06.647 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44937fe700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f44800037c0 0x7f4480003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.647 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f44800037c0 0x7f4480003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.647 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 -- 172.21.15.112:0/2190653722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480003280 con 0x7f4480004e90 2020-11-20T11:18:06.648 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44937fe700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f44800037c0 0x7f4480003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:06.648 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 -- 172.21.15.112:0/2190653722 reap_dead start 2020-11-20T11:18:06.649 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f4493fff700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f448000b770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f448c001ef0 tx=0x7f448c007f50).ready entity=mon.0 client_cookie=7606b6c98d7bb40e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.649 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00c9e0 con 0x7f4480004e90 2020-11-20T11:18:06.649 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00cb40 con 0x7f4480004e90 2020-11-20T11:18:06.650 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.628+0000 7f44927fc700 1 -- 172.21.15.112:0/2190653722 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0068b0 con 0x7f4480004e90 2020-11-20T11:18:06.650 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 -- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 msgr2=0x7f448000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.651 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f448000b770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f448c001ef0 tx=0x7f448c007f50).stop 2020-11-20T11:18:06.651 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 -- 172.21.15.112:0/2190653722 shutdown_connections 2020-11-20T11:18:06.651 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 --2- 172.21.15.112:0/2190653722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f448000b770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.652 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 -- 172.21.15.112:0/2190653722 >> 172.21.15.112:0/2190653722 conn(0x7f44940bac60 msgr2=0x7f44940bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.652 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 -- 172.21.15.112:0/2190653722 shutdown_connections 2020-11-20T11:18:06.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.629+0000 7f4499fc7700 1 -- 172.21.15.112:0/2190653722 wait complete. 2020-11-20T11:18:06.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.630+0000 7f4499fc7700 1 Processor -- start 2020-11-20T11:18:06.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.630+0000 7f4499fc7700 1 -- start start 2020-11-20T11:18:06.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 0x7f449414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4494163f80 0x7f4494164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c4930 con 0x7f4480004e90 2020-11-20T11:18:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449414bae0 con 0x7f449414b170 2020-11-20T11:18:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4499fc7700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494161760 con 0x7f4494163f80 2020-11-20T11:18:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50630/0 (socket says 172.21.15.112:50630) 2020-11-20T11:18:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 -- 172.21.15.112:0/4023322484 learned_addr learned my addr 172.21.15.112:0/4023322484 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4492ffd700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 0x7f449414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4493fff700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4494163f80 0x7f4494164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 -- 172.21.15.112:0/4023322484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4494163f80 msgr2=0x7f4494164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4494163f80 0x7f4494164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 -- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 msgr2=0x7f449414b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 0x7f449414b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 -- 172.21.15.112:0/4023322484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494061fa0 con 0x7f4480004e90 2020-11-20T11:18:06.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f4492ffd700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 0x7f449414b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:06.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44937fe700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f448400f830 tx=0x7f4484008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.631+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484013610 con 0x7f4480004e90 2020-11-20T11:18:06.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.632+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484000e90 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.632+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940c4b20 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.632+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484013980 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.632+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c5060 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.632+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494065610 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.633+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4484013d70 con 0x7f4480004e90 2020-11-20T11:18:06.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.633+0000 7f44737fe700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 0x7f446c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.634+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f44840a2990 con 0x7f4480004e90 2020-11-20T11:18:06.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.634+0000 7f4492ffd700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 0x7f446c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.634+0000 7f4492ffd700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 0x7f446c082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4488007810 tx=0x7f4488009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.637+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4484077340 con 0x7f4480004e90 2020-11-20T11:18:06.704 INFO:tasks.ceph.mds.a.smithi112.stderr:2020-11-20T11:18:06.701+0000 7f23f8d77700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T11:18:06.783 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.780+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44940c5220 con 0x7f4480004e90 2020-11-20T11:18:06.784 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.780+0000 7f44737fe700 1 -- 172.21.15.112:0/4023322484 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4484017020 con 0x7f4480004e90 2020-11-20T11:18:06.784 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 msgr2=0x7f446c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 0x7f446c082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4488007810 tx=0x7f4488009040).stop 2020-11-20T11:18:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 msgr2=0x7f4494161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f448400f830 tx=0x7f4484008040).stop 2020-11-20T11:18:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 shutdown_connections 2020-11-20T11:18:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f446c080670 0x7f446c082b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.789 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4494163f80 0x7f4494164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.789 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4480004e90 0x7f4494161270 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 --2- 172.21.15.112:0/4023322484 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f449414b170 0x7f449414b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 >> 172.21.15.112:0/4023322484 conn(0x7f44940bac60 msgr2=0x7f4494067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 shutdown_connections 2020-11-20T11:18:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.782+0000 7f4499fc7700 1 -- 172.21.15.112:0/4023322484 wait complete. 2020-11-20T11:18:06.796 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:18:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.906+0000 7f4137fff700 1 Processor -- start 2020-11-20T11:18:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.906+0000 7f4137fff700 1 -- start start 2020-11-20T11:18:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f4137fff700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f413805c060 0x7f4138151f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f4137fff700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380c4d40 con 0x7f41380c4fa0 2020-11-20T11:18:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f4137fff700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4138154cc0 con 0x7f413805bc80 2020-11-20T11:18:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f4137fff700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4138154f60 con 0x7f413805c060 2020-11-20T11:18:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f412ffff700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f41380c4fa0 0x7f4138151880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45484/0 (socket says 172.21.15.112:45484) 2020-11-20T11:18:06.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f412ffff700 1 -- 172.21.15.112:0/2256817330 learned_addr learned my addr 172.21.15.112:0/2256817330 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:06.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41377fe700 1 --2- 172.21.15.112:0/2256817330 >> v2:172.21.15.204:3300/0 conn(0x7f413805c060 0x7f4138151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311651587 0 0) 0x7f41380c4d40 con 0x7f41380c4fa0 2020-11-20T11:18:06.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4118003280 con 0x7f41380c4fa0 2020-11-20T11:18:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41377fe700 1 -- 172.21.15.112:0/2256817330 >> v1:172.21.15.204:6789/0 conn(0x7f413805bc80 legacy=0x7f41380bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523431022 0 0) 0x7f4138154cc0 con 0x7f413805bc80 2020-11-20T11:18:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41377fe700 1 -- 172.21.15.112:0/2256817330 >> v1:172.21.15.166:6789/0 conn(0x7f41380c4fa0 legacy=0x7f4138151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41377fe700 1 -- 172.21.15.112:0/2256817330 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138155200 con 0x7f413805c060 2020-11-20T11:18:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.907+0000 7f41377fe700 1 --2- 172.21.15.112:0/2256817330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f413805c060 0x7f4138151f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4130009cc0 tx=0x7f4130009220).ready entity=mon.2 client_cookie=1ee8980af509f589 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130005ae0 con 0x7f413805c060 2020-11-20T11:18:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130005c40 con 0x7f413805c060 2020-11-20T11:18:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f41367fc700 1 -- 172.21.15.112:0/2256817330 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000ba10 con 0x7f413805c060 2020-11-20T11:18:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 -- 172.21.15.112:0/2256817330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f413805c060 msgr2=0x7f4138151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 --2- 172.21.15.112:0/2256817330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f413805c060 0x7f4138151f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4130009cc0 tx=0x7f4130009220).stop 2020-11-20T11:18:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 -- 172.21.15.112:0/2256817330 shutdown_connections 2020-11-20T11:18:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 --2- 172.21.15.112:0/2256817330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f413805c060 0x7f4138151f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 -- 172.21.15.112:0/2256817330 >> 172.21.15.112:0/2256817330 conn(0x7f4138060820 msgr2=0x7f41380624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 -- 172.21.15.112:0/2256817330 shutdown_connections 2020-11-20T11:18:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.908+0000 7f4137fff700 1 -- 172.21.15.112:0/2256817330 wait complete. 2020-11-20T11:18:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.909+0000 7f4137fff700 1 Processor -- start 2020-11-20T11:18:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.909+0000 7f4137fff700 1 -- start start 2020-11-20T11:18:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 0x7f41380be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380c4fa0 0x7f413814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4138083d10 con 0x7f413805bc80 2020-11-20T11:18:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4138083fb0 con 0x7f413805c060 2020-11-20T11:18:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4137fff700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381503e0 con 0x7f41380c4fa0 2020-11-20T11:18:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50642/0 (socket says 172.21.15.112:50642) 2020-11-20T11:18:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 -- 172.21.15.112:0/3131731418 learned_addr learned my addr 172.21.15.112:0/3131731418 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f412ffff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 0x7f41380be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f41377fe700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380c4fa0 0x7f413814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 -- 172.21.15.112:0/3131731418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380c4fa0 msgr2=0x7f413814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380c4fa0 0x7f413814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 -- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 msgr2=0x7f41380be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 0x7f41380be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f4136ffd700 1 -- 172.21.15.112:0/3131731418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138150680 con 0x7f413805bc80 2020-11-20T11:18:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.910+0000 7f412ffff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 0x7f41380be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f4136ffd700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f412800c710 tx=0x7f4128007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128010510 con 0x7f413805bc80 2020-11-20T11:18:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4128010670 con 0x7f413805bc80 2020-11-20T11:18:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4138150920 con 0x7f413805bc80 2020-11-20T11:18:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128010a10 con 0x7f413805bc80 2020-11-20T11:18:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.911+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138151060 con 0x7f413805bc80 2020-11-20T11:18:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.912+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138154980 con 0x7f413805bc80 2020-11-20T11:18:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.912+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4128010070 con 0x7f413805bc80 2020-11-20T11:18:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.913+0000 7f412effd700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 0x7f4114082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.913+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f41280a2160 con 0x7f413805bc80 2020-11-20T11:18:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.913+0000 7f412ffff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 0x7f4114082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.913+0000 7f412ffff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 0x7f4114082b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f41380c3540 tx=0x7f4120009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:06.916+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4128076b70 con 0x7f413805bc80 2020-11-20T11:18:07.059 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.056+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4138150d80 con 0x7f413805bc80 2020-11-20T11:18:07.059 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.056+0000 7f412effd700 1 -- 172.21.15.112:0/3131731418 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+10 (secure 0 0 0) 0x7f412807a190 con 0x7f413805bc80 2020-11-20T11:18:07.059 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:07.060 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 msgr2=0x7f4114082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 0x7f4114082b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f41380c3540 tx=0x7f4120009040).stop 2020-11-20T11:18:07.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 msgr2=0x7f4138083760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f412800c710 tx=0x7f4128007a60).stop 2020-11-20T11:18:07.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 shutdown_connections 2020-11-20T11:18:07.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f41140806a0 0x7f4114082b60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380c4fa0 0x7f413814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f413805bc80 0x7f4138083760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 --2- 172.21.15.112:0/3131731418 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f413805c060 0x7f41380be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 >> 172.21.15.112:0/3131731418 conn(0x7f4138060820 msgr2=0x7f4138066040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 shutdown_connections 2020-11-20T11:18:07.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.057+0000 7f4137fff700 1 -- 172.21.15.112:0/3131731418 wait complete. 2020-11-20T11:18:07.071 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T11:18:07.072 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T11:18:07.072 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T11:18:07.180 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.177+0000 7f22c4385700 1 Processor -- start 2020-11-20T11:18:07.180 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.177+0000 7f22c4385700 1 -- start start 2020-11-20T11:18:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c4385700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f22bc0616f0 0x7f22bc061ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c4385700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22bc0bd500 0x7f22bc0bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c4385700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0c11d0 con 0x7f22bc0bdea0 2020-11-20T11:18:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c4385700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0c1470 con 0x7f22bc0bd500 2020-11-20T11:18:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c4385700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0c1710 con 0x7f22bc0616f0 2020-11-20T11:18:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.178+0000 7f22c1920700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22bc0bd500 0x7f22bc0bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22bc0bd500 0x7f22bc0bd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50650/0 (socket says 172.21.15.112:50650) 2020-11-20T11:18:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 -- 172.21.15.112:0/3192766159 learned_addr learned my addr 172.21.15.112:0/3192766159 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c2121700 1 --2- 172.21.15.112:0/3192766159 >> v2:172.21.15.204:3300/0 conn(0x7f22bc0616f0 0x7f22bc061ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 -- 172.21.15.112:0/3192766159 >> v2:172.21.15.204:3300/0 conn(0x7f22bc0616f0 msgr2=0x7f22bc061ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 --2- 172.21.15.112:0/3192766159 >> v2:172.21.15.204:3300/0 conn(0x7f22bc0616f0 0x7f22bc061ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 -- 172.21.15.112:0/3192766159 >> v1:172.21.15.204:6789/0 conn(0x7f22bc0bdea0 legacy=0x7f22bc1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 -- 172.21.15.112:0/3192766159 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0c19b0 con 0x7f22bc0bd500 2020-11-20T11:18:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c1920700 1 --2- 172.21.15.112:0/3192766159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bd500 0x7f22bc0bd9b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f22bc0c57f0 tx=0x7f22b8006ef0).ready entity=mon.0 client_cookie=4261784f10be7e86 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c111f700 1 -- 172.21.15.112:0/3192766159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800b820 con 0x7f22bc0bd500 2020-11-20T11:18:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c111f700 1 -- 172.21.15.112:0/3192766159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8000e90 con 0x7f22bc0bd500 2020-11-20T11:18:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c111f700 1 -- 172.21.15.112:0/3192766159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800bb90 con 0x7f22bc0bd500 2020-11-20T11:18:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c4385700 1 -- 172.21.15.112:0/3192766159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bd500 msgr2=0x7f22bc0bd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.179+0000 7f22c4385700 1 --2- 172.21.15.112:0/3192766159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bd500 0x7f22bc0bd9b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f22bc0c57f0 tx=0x7f22b8006ef0).stop 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 -- 172.21.15.112:0/3192766159 shutdown_connections 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 --2- 172.21.15.112:0/3192766159 >> v2:172.21.15.204:3300/0 conn(0x7f22bc0616f0 0x7f22bc061ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 --2- 172.21.15.112:0/3192766159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bd500 0x7f22bc0bd9b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 -- 172.21.15.112:0/3192766159 >> 172.21.15.112:0/3192766159 conn(0x7f22bc0bac60 msgr2=0x7f22bc0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 -- 172.21.15.112:0/3192766159 shutdown_connections 2020-11-20T11:18:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.180+0000 7f22c4385700 1 -- 172.21.15.112:0/3192766159 wait complete. 2020-11-20T11:18:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 Processor -- start 2020-11-20T11:18:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 -- start start 2020-11-20T11:18:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 0x7f22bc154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc0bd500 0x7f22bc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0c0770 con 0x7f22bc0bdea0 2020-11-20T11:18:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0c34f0 con 0x7f22bc0616f0 2020-11-20T11:18:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c4385700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0c3790 con 0x7f22bc0bd500 2020-11-20T11:18:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.181+0000 7f22c2922700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50658/0 (socket says 172.21.15.112:50658) 2020-11-20T11:18:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 -- 172.21.15.112:0/3669062717 learned_addr learned my addr 172.21.15.112:0/3669062717 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c1920700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc0bd500 0x7f22bc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2121700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 0x7f22bc154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 -- 172.21.15.112:0/3669062717 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc0bd500 msgr2=0x7f22bc1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc0bd500 0x7f22bc1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 -- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 msgr2=0x7f22bc154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 0x7f22bc154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 -- 172.21.15.112:0/3669062717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0c3a30 con 0x7f22bc0bdea0 2020-11-20T11:18:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2121700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 0x7f22bc154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c2922700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f22b400bae0 tx=0x7f22b40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400c7a0 con 0x7f22bc0bdea0 2020-11-20T11:18:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400c920 con 0x7f22bc0bdea0 2020-11-20T11:18:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc0c3cd0 con 0x7f22bc0bdea0 2020-11-20T11:18:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400cad0 con 0x7f22bc0bdea0 2020-11-20T11:18:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.182+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc0c4210 con 0x7f22bc0bdea0 2020-11-20T11:18:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.183+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc05d370 con 0x7f22bc0bdea0 2020-11-20T11:18:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.184+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f22b401c070 con 0x7f22bc0bdea0 2020-11-20T11:18:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.184+0000 7f22aa7fc700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 0x7f2294082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.185+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f22b40a2110 con 0x7f22bc0bdea0 2020-11-20T11:18:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.185+0000 7f22c2121700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 0x7f2294082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.185+0000 7f22c2121700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 0x7f2294082b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f22ac009750 tx=0x7f22ac008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.188+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f22b4076b20 con 0x7f22bc0bdea0 2020-11-20T11:18:07.362 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.359+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f22bc0666c0 con 0x7f22bc0bdea0 2020-11-20T11:18:07.365 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.363+0000 7f22aa7fc700 1 -- 172.21.15.112:0/3669062717 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+202045 (secure 0 0 0) 0x7f22b401a020 con 0x7f22bc0bdea0 2020-11-20T11:18:07.368 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:07.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 msgr2=0x7f2294082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 0x7f2294082b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f22ac009750 tx=0x7f22ac008040).stop 2020-11-20T11:18:07.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 msgr2=0x7f22bc151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f22b400bae0 tx=0x7f22b40090f0).stop 2020-11-20T11:18:07.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 shutdown_connections 2020-11-20T11:18:07.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2294080670 0x7f2294082b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22bc0bdea0 0x7f22bc151ba0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f22bc0616f0 0x7f22bc154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 --2- 172.21.15.112:0/3669062717 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc0bd500 0x7f22bc1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 >> 172.21.15.112:0/3669062717 conn(0x7f22bc0bac60 msgr2=0x7f22bc145f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 shutdown_connections 2020-11-20T11:18:07.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.365+0000 7f22c4385700 1 -- 172.21.15.112:0/3669062717 wait complete. 2020-11-20T11:18:07.379 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":4,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":22614},{"type":"v1","addr":"172.21.15.166:6801","nonce":22614}]},"active_addr":"172.21.15.166:6801/22614","active_change":"2020-11-20T11:17:46.054817+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4106,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4110,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.166:0","nonce":2519655972}]},{"addrvec":[{"type":"v2","addr":"172.21.15.166:0","nonce":3228701353}]},{"addrvec":[{"type":"v2","addr":"172.21.15.166:0","nonce":2136462443}]}]}} 2020-11-20T11:18:07.386 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T11:18:07.387 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T11:18:07.387 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:07.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.524+0000 7f644937b700 1 Processor -- start 2020-11-20T11:18:07.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.524+0000 7f644937b700 1 -- start start 2020-11-20T11:18:07.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f644937b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 0x7f6444066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f644937b700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f64440bfa50 0x7f64440c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f644937b700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440c5230 con 0x7f64440c4c60 2020-11-20T11:18:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f644937b700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64441549c0 con 0x7f6444065d30 2020-11-20T11:18:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f644937b700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6444154c60 con 0x7f64440bfa50 2020-11-20T11:18:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f6442ffd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 0x7f6444066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f64427fc700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f64440bfa50 0x7f64440c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f6442ffd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 0x7f6444066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:38658/0 (socket says 172.21.15.112:38658) 2020-11-20T11:18:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f64427fc700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f64440bfa50 0x7f64440c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:36440/0 (socket says 172.21.15.112:36440) 2020-11-20T11:18:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.525+0000 7f6442ffd700 1 -- 172.21.15.112:0/4114227384 learned_addr learned my addr 172.21.15.112:0/4114227384 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f64427fc700 1 -- 172.21.15.112:0/4114227384 >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 msgr2=0x7f6444066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f64427fc700 1 --2- 172.21.15.112:0/4114227384 >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 0x7f6444066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f64427fc700 1 -- 172.21.15.112:0/4114227384 >> v1:172.21.15.166:6789/0 conn(0x7f64440c4c60 legacy=0x7f64441512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f64427fc700 1 -- 172.21.15.112:0/4114227384 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444154f00 con 0x7f64440bfa50 2020-11-20T11:18:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f64427fc700 1 --2- 172.21.15.112:0/4114227384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440bfa50 0x7f64440c4770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6444066600 tx=0x7f6438006e30).ready entity=mon.2 client_cookie=6ae8e18312b8eec6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f6441ffb700 1 -- 172.21.15.112:0/4114227384 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380097b0 con 0x7f64440bfa50 2020-11-20T11:18:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f6441ffb700 1 -- 172.21.15.112:0/4114227384 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438000e90 con 0x7f64440bfa50 2020-11-20T11:18:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f6441ffb700 1 -- 172.21.15.112:0/4114227384 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438009b20 con 0x7f64440bfa50 2020-11-20T11:18:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f644937b700 1 -- 172.21.15.112:0/4114227384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440bfa50 msgr2=0x7f64440c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.526+0000 7f644937b700 1 --2- 172.21.15.112:0/4114227384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440bfa50 0x7f64440c4770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6444066600 tx=0x7f6438006e30).stop 2020-11-20T11:18:07.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 -- 172.21.15.112:0/4114227384 shutdown_connections 2020-11-20T11:18:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 --2- 172.21.15.112:0/4114227384 >> v2:172.21.15.166:3300/0 conn(0x7f6444065d30 0x7f6444066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 --2- 172.21.15.112:0/4114227384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440bfa50 0x7f64440c4770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 -- 172.21.15.112:0/4114227384 >> 172.21.15.112:0/4114227384 conn(0x7f644405bac0 msgr2=0x7f644405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 -- 172.21.15.112:0/4114227384 shutdown_connections 2020-11-20T11:18:07.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.527+0000 7f644937b700 1 -- 172.21.15.112:0/4114227384 wait complete. 2020-11-20T11:18:07.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.528+0000 7f644937b700 1 Processor -- start 2020-11-20T11:18:07.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.528+0000 7f644937b700 1 -- start start 2020-11-20T11:18:07.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.528+0000 7f644937b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f64440bfa50 0x7f6444153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 0x7f6444157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440c5af0 con 0x7f6444065d30 2020-11-20T11:18:07.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644414ded0 con 0x7f64440bfa50 2020-11-20T11:18:07.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64441609c0 con 0x7f64440c4c60 2020-11-20T11:18:07.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50666/0 (socket says 172.21.15.112:50666) 2020-11-20T11:18:07.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 -- 172.21.15.112:0/2155396765 learned_addr learned my addr 172.21.15.112:0/2155396765 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f64427fc700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f64440bfa50 0x7f6444153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f64437fe700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 0x7f6444157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 -- 172.21.15.112:0/2155396765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 msgr2=0x7f6444157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 0x7f6444157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 -- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f64440bfa50 msgr2=0x7f6444153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f64440bfa50 0x7f6444153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 -- 172.21.15.112:0/2155396765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444160c60 con 0x7f6444065d30 2020-11-20T11:18:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f64437fe700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 0x7f6444157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f6442ffd700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f643400eba0 tx=0x7f6434006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400c8e0 con 0x7f6444065d30 2020-11-20T11:18:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400ca40 con 0x7f6444065d30 2020-11-20T11:18:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6444160f00 con 0x7f6444065d30 2020-11-20T11:18:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400cdc0 con 0x7f6444065d30 2020-11-20T11:18:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.529+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64441616e0 con 0x7f6444065d30 2020-11-20T11:18:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.530+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64440666c0 con 0x7f6444065d30 2020-11-20T11:18:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.531+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6434022070 con 0x7f6444065d30 2020-11-20T11:18:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.531+0000 7f642affd700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 0x7f6420082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.531+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f64340a2e40 con 0x7f6444065d30 2020-11-20T11:18:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.532+0000 7f64427fc700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 0x7f6420082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.532+0000 7f64427fc700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 0x7f6420082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6438006e70 tx=0x7f6438015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.535+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f64340777d0 con 0x7f6444065d30 2020-11-20T11:18:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.677+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6444069510 con 0x7f6444065d30 2020-11-20T11:18:07.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.678+0000 7f642affd700 1 -- 172.21.15.112:0/2155396765 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f6434085570 con 0x7f6444065d30 2020-11-20T11:18:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:07.681 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:07.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 msgr2=0x7f6420082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 0x7f6420082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6438006e70 tx=0x7f6438015000).stop 2020-11-20T11:18:07.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 msgr2=0x7f644414d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f643400eba0 tx=0x7f6434006ef0).stop 2020-11-20T11:18:07.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 shutdown_connections 2020-11-20T11:18:07.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6420080670 0x7f6420082b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64440c4c60 0x7f6444157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444065d30 0x7f644414d9e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 --2- 172.21.15.112:0/2155396765 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f64440bfa50 0x7f6444153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.679+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 >> 172.21.15.112:0/2155396765 conn(0x7f644405bac0 msgr2=0x7f644414fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.680+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 shutdown_connections 2020-11-20T11:18:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.680+0000 7f644937b700 1 -- 172.21.15.112:0/2155396765 wait complete. 2020-11-20T11:18:07.694 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T11:18:07.694 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:07.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.801+0000 7f15a30ba700 1 Processor -- start 2020-11-20T11:18:07.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.801+0000 7f15a30ba700 1 -- start start 2020-11-20T11:18:07.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f159c065d30 0x7f159c066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f159c1512e0 0x7f159c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0c5230 con 0x7f159c0bfa50 2020-11-20T11:18:07.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c1549c0 con 0x7f159c065d30 2020-11-20T11:18:07.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c154c60 con 0x7f159c1512e0 2020-11-20T11:18:07.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f159c065d30 0x7f159c066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f159c065d30 0x7f159c066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50674/0 (socket says 172.21.15.112:50674) 2020-11-20T11:18:07.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 -- 172.21.15.112:0/3841387102 learned_addr learned my addr 172.21.15.112:0/3841387102 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f159bfff700 1 --1- 172.21.15.112:0/3841387102 >> v1:172.21.15.112:6789/0 conn(0x7f159c0bfa50 0x7f159c0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34868/0 (socket says 172.21.15.112:34868) 2020-11-20T11:18:07.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a1657700 1 --2- 172.21.15.112:0/3841387102 >> v2:172.21.15.166:3300/0 conn(0x7f159c1512e0 0x7f159c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 -- 172.21.15.112:0/3841387102 >> v2:172.21.15.166:3300/0 conn(0x7f159c1512e0 msgr2=0x7f159c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:07.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 --2- 172.21.15.112:0/3841387102 >> v2:172.21.15.166:3300/0 conn(0x7f159c1512e0 0x7f159c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 -- 172.21.15.112:0/3841387102 >> v1:172.21.15.112:6789/0 conn(0x7f159c0bfa50 legacy=0x7f159c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 -- 172.21.15.112:0/3841387102 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c154f00 con 0x7f159c065d30 2020-11-20T11:18:07.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a0e56700 1 --2- 172.21.15.112:0/3841387102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c065d30 0x7f159c066110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f159c0651b0 tx=0x7f1590006ef0).ready entity=mon.0 client_cookie=fef0b95ee0750a1a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f159b7fe700 1 -- 172.21.15.112:0/3841387102 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000b760 con 0x7f159c065d30 2020-11-20T11:18:07.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f159b7fe700 1 -- 172.21.15.112:0/3841387102 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590000e90 con 0x7f159c065d30 2020-11-20T11:18:07.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f159b7fe700 1 -- 172.21.15.112:0/3841387102 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000bad0 con 0x7f159c065d30 2020-11-20T11:18:07.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- 172.21.15.112:0/3841387102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c065d30 msgr2=0x7f159c066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 --2- 172.21.15.112:0/3841387102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c065d30 0x7f159c066110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f159c0651b0 tx=0x7f1590006ef0).stop 2020-11-20T11:18:07.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- 172.21.15.112:0/3841387102 shutdown_connections 2020-11-20T11:18:07.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 --2- 172.21.15.112:0/3841387102 >> v2:172.21.15.166:3300/0 conn(0x7f159c1512e0 0x7f159c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 --2- 172.21.15.112:0/3841387102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c065d30 0x7f159c066110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- 172.21.15.112:0/3841387102 >> 172.21.15.112:0/3841387102 conn(0x7f159c05bac0 msgr2=0x7f159c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- 172.21.15.112:0/3841387102 shutdown_connections 2020-11-20T11:18:07.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.803+0000 7f15a30ba700 1 -- 172.21.15.112:0/3841387102 wait complete. 2020-11-20T11:18:07.813 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.804+0000 7f15a30ba700 1 Processor -- start 2020-11-20T11:18:07.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 -- start start 2020-11-20T11:18:07.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f159c065d30 0x7f159c14d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f159c0bfa50 0x7f159c164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c165040 con 0x7f159c1512e0 2020-11-20T11:18:07.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c8270 con 0x7f159c065d30 2020-11-20T11:18:07.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a30ba700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c8510 con 0x7f159c0bfa50 2020-11-20T11:18:07.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a1657700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a1657700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50682/0 (socket says 172.21.15.112:50682) 2020-11-20T11:18:07.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a1657700 1 -- 172.21.15.112:0/1702674971 learned_addr learned my addr 172.21.15.112:0/1702674971 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:07.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.805+0000 7f15a0e56700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f159c065d30 0x7f159c14d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 -- 172.21.15.112:0/1702674971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f159c0bfa50 msgr2=0x7f159c164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f159c0bfa50 0x7f159c164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:07.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 -- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f159c065d30 msgr2=0x7f159c14d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f159c065d30 0x7f159c14d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 -- 172.21.15.112:0/1702674971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c14c620 con 0x7f159c1512e0 2020-11-20T11:18:07.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a1657700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f159400ebf0 tx=0x7f1594008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400c710 con 0x7f159c1512e0 2020-11-20T11:18:07.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400c870 con 0x7f159c1512e0 2020-11-20T11:18:07.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c14c8c0 con 0x7f159c1512e0 2020-11-20T11:18:07.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400cc30 con 0x7f159c1512e0 2020-11-20T11:18:07.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.806+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c14bb30 con 0x7f159c1512e0 2020-11-20T11:18:07.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.807+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c14cd20 con 0x7f159c1512e0 2020-11-20T11:18:07.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.807+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f159401d460 con 0x7f159c1512e0 2020-11-20T11:18:07.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.808+0000 7f1598ff9700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 0x7f1574082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:07.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.808+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f15940a2960 con 0x7f159c1512e0 2020-11-20T11:18:07.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.808+0000 7f15a0e56700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 0x7f1574082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:07.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.809+0000 7f15a0e56700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 0x7f1574082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1590006f30 tx=0x7f1590015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:07.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.812+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1594077310 con 0x7f159c1512e0 2020-11-20T11:18:07.954 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.951+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f159c14c450 con 0x7f159c1512e0 2020-11-20T11:18:07.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.952+0000 7f1598ff9700 1 -- 172.21.15.112:0/1702674971 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f159407a930 con 0x7f159c1512e0 2020-11-20T11:18:07.955 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:07.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 msgr2=0x7f1574082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 0x7f1574082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1590006f30 tx=0x7f1590015000).stop 2020-11-20T11:18:07.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 msgr2=0x7f159c14b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:07.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f159400ebf0 tx=0x7f1594008040).stop 2020-11-20T11:18:07.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 shutdown_connections 2020-11-20T11:18:07.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1574080670 0x7f1574082b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f159c1512e0 0x7f159c14b640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f159c065d30 0x7f159c14d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:07.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 --2- 172.21.15.112:0/1702674971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f159c0bfa50 0x7f159c164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:07.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 >> 172.21.15.112:0/1702674971 conn(0x7f159c05bac0 msgr2=0x7f159c14f140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:07.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 shutdown_connections 2020-11-20T11:18:07.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:07.954+0000 7f15a30ba700 1 -- 172.21.15.112:0/1702674971 wait complete. 2020-11-20T11:18:07.968 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T11:18:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.075+0000 7fcd470a2700 1 Processor -- start 2020-11-20T11:18:08.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.075+0000 7fcd470a2700 1 -- start start 2020-11-20T11:18:08.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd40066110 0x7fcd400bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fcd401512e0 0x7fcd40151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400c5230 con 0x7fcd40065d30 2020-11-20T11:18:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400bff40 con 0x7fcd401512e0 2020-11-20T11:18:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd401549c0 con 0x7fcd40066110 2020-11-20T11:18:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd40066110 0x7fcd400bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd40066110 0x7fcd400bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:36464/0 (socket says 172.21.15.112:36464) 2020-11-20T11:18:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 -- 172.21.15.112:0/1141606725 learned_addr learned my addr 172.21.15.112:0/1141606725 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd4563f700 1 --2- 172.21.15.112:0/1141606725 >> v2:172.21.15.166:3300/0 conn(0x7fcd401512e0 0x7fcd40151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 -- 172.21.15.112:0/1141606725 >> v2:172.21.15.166:3300/0 conn(0x7fcd401512e0 msgr2=0x7fcd40151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 --2- 172.21.15.112:0/1141606725 >> v2:172.21.15.166:3300/0 conn(0x7fcd401512e0 0x7fcd40151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 -- 172.21.15.112:0/1141606725 >> v1:172.21.15.166:6789/0 conn(0x7fcd40065d30 legacy=0x7fcd400c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 -- 172.21.15.112:0/1141606725 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40154c60 con 0x7fcd40066110 2020-11-20T11:18:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3ffff700 1 --2- 172.21.15.112:0/1141606725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400bfa50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fcd400651b0 tx=0x7fcd2c006ef0).ready entity=mon.2 client_cookie=3606eca7a91b1b48 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3f7fe700 1 -- 172.21.15.112:0/1141606725 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00b860 con 0x7fcd40066110 2020-11-20T11:18:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3f7fe700 1 -- 172.21.15.112:0/1141606725 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c000e90 con 0x7fcd40066110 2020-11-20T11:18:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd3f7fe700 1 -- 172.21.15.112:0/1141606725 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00bbd0 con 0x7fcd40066110 2020-11-20T11:18:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- 172.21.15.112:0/1141606725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 msgr2=0x7fcd400bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 --2- 172.21.15.112:0/1141606725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400bfa50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fcd400651b0 tx=0x7fcd2c006ef0).stop 2020-11-20T11:18:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- 172.21.15.112:0/1141606725 shutdown_connections 2020-11-20T11:18:08.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 --2- 172.21.15.112:0/1141606725 >> v2:172.21.15.166:3300/0 conn(0x7fcd401512e0 0x7fcd40151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 --2- 172.21.15.112:0/1141606725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400bfa50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- 172.21.15.112:0/1141606725 >> 172.21.15.112:0/1141606725 conn(0x7fcd4005bac0 msgr2=0x7fcd4005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- 172.21.15.112:0/1141606725 shutdown_connections 2020-11-20T11:18:08.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.077+0000 7fcd470a2700 1 -- 172.21.15.112:0/1141606725 wait complete. 2020-11-20T11:18:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.078+0000 7fcd470a2700 1 Processor -- start 2020-11-20T11:18:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.078+0000 7fcd470a2700 1 -- start start 2020-11-20T11:18:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 0x7fcd401581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd401512e0 0x7fcd400c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c76c0 con 0x7fcd40065d30 2020-11-20T11:18:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40160930 con 0x7fcd401512e0 2020-11-20T11:18:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd470a2700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40160bc0 con 0x7fcd40066110 2020-11-20T11:18:08.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd44e3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 0x7fcd401581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd44e3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 0x7fcd401581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50692/0 (socket says 172.21.15.112:50692) 2020-11-20T11:18:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd44e3e700 1 -- 172.21.15.112:0/3763317029 learned_addr learned my addr 172.21.15.112:0/3763317029 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd3ffff700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.079+0000 7fcd4563f700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd401512e0 0x7fcd400c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 -- 172.21.15.112:0/3763317029 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 msgr2=0x7fcd400c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd40066110 0x7fcd400c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 -- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd401512e0 msgr2=0x7fcd400c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd401512e0 0x7fcd400c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40160e60 con 0x7fcd40065d30 2020-11-20T11:18:08.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd44e3e700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 0x7fcd401581d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcd3400c710 tx=0x7fcd34007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34001ea0 con 0x7fcd40065d30 2020-11-20T11:18:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34013410 con 0x7fcd40065d30 2020-11-20T11:18:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd40161100 con 0x7fcd40065d30 2020-11-20T11:18:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340137b0 con 0x7fcd40065d30 2020-11-20T11:18:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.080+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40161640 con 0x7fcd40065d30 2020-11-20T11:18:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.081+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd40161840 con 0x7fcd40065d30 2020-11-20T11:18:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.081+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcd34010030 con 0x7fcd40065d30 2020-11-20T11:18:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3cff9700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd18080670 0x7fcd18082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcd340a2de0 con 0x7fcd40065d30 2020-11-20T11:18:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3cff9700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7fcd180893a0 0x7fcd1808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd1808be20 con 0x7fcd180893a0 2020-11-20T11:18:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd340a3150 con 0x7fcd40065d30 2020-11-20T11:18:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3ffff700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd18080670 0x7fcd18082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd4563f700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7fcd180893a0 0x7fcd1808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.082+0000 7fcd3ffff700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd18080670 0x7fcd18082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcd2c006f30 tx=0x7fcd2c016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.083+0000 7fcd4563f700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7fcd180893a0 0x7fcd1808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.083+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== osd.0 v2:172.21.15.112:6800/23140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fcd1808be20 con 0x7fcd180893a0 2020-11-20T11:18:08.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 --> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd40065740 con 0x7fcd180893a0 2020-11-20T11:18:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd3cff9700 1 -- 172.21.15.112:0/3763317029 <== osd.0 v2:172.21.15.112:6800/23140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd40065740 con 0x7fcd180893a0 2020-11-20T11:18:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7fcd180893a0 msgr2=0x7fcd1808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7fcd180893a0 0x7fcd1808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd18080670 msgr2=0x7fcd18082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd18080670 0x7fcd18082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcd2c006f30 tx=0x7fcd2c016000).stop 2020-11-20T11:18:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 msgr2=0x7fcd401581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 --2- 172.21.15.112:0/3763317029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd40065d30 0x7fcd401581d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcd3400c710 tx=0x7fcd34007c40).stop 2020-11-20T11:18:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd4563f700 1 -- 172.21.15.112:0/3763317029 reap_dead start 2020-11-20T11:18:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 shutdown_connections 2020-11-20T11:18:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 >> 172.21.15.112:0/3763317029 conn(0x7fcd4005bac0 msgr2=0x7fcd40060790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 shutdown_connections 2020-11-20T11:18:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.097+0000 7fcd470a2700 1 -- 172.21.15.112:0/3763317029 wait complete. 2020-11-20T11:18:08.111 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:08.112 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T11:18:08.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 Processor -- start 2020-11-20T11:18:08.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 -- start start 2020-11-20T11:18:08.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f83f4066110 0x7f83f40bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83f41512e0 0x7f83f4151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40c5230 con 0x7f83f4065d30 2020-11-20T11:18:08.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40bff40 con 0x7f83f41512e0 2020-11-20T11:18:08.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83fa03a700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f41549c0 con 0x7f83f4066110 2020-11-20T11:18:08.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83f41512e0 0x7f83f4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83f41512e0 0x7f83f4151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50702/0 (socket says 172.21.15.112:50702) 2020-11-20T11:18:08.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 -- 172.21.15.112:0/3620103015 learned_addr learned my addr 172.21.15.112:0/3620103015 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f2ffd700 1 --2- 172.21.15.112:0/3620103015 >> v2:172.21.15.166:3300/0 conn(0x7f83f4066110 0x7f83f40bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 -- 172.21.15.112:0/3620103015 >> v2:172.21.15.166:3300/0 conn(0x7f83f4066110 msgr2=0x7f83f40bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 --2- 172.21.15.112:0/3620103015 >> v2:172.21.15.166:3300/0 conn(0x7f83f4066110 0x7f83f40bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 -- 172.21.15.112:0/3620103015 >> v1:172.21.15.166:6789/0 conn(0x7f83f4065d30 legacy=0x7f83f40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 -- 172.21.15.112:0/3620103015 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4154c60 con 0x7f83f41512e0 2020-11-20T11:18:08.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f3fff700 1 --2- 172.21.15.112:0/3620103015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f41512e0 0x7f83f4151710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f83f40651b0 tx=0x7f83ec0092d0).ready entity=mon.0 client_cookie=104b5566c27ab724 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f27fc700 1 -- 172.21.15.112:0/3620103015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00bbb0 con 0x7f83f41512e0 2020-11-20T11:18:08.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f27fc700 1 -- 172.21.15.112:0/3620103015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00bd10 con 0x7f83f41512e0 2020-11-20T11:18:08.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.220+0000 7f83f27fc700 1 -- 172.21.15.112:0/3620103015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec011610 con 0x7f83f41512e0 2020-11-20T11:18:08.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 -- 172.21.15.112:0/3620103015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f41512e0 msgr2=0x7f83f4151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3620103015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f41512e0 0x7f83f4151710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f83f40651b0 tx=0x7f83ec0092d0).stop 2020-11-20T11:18:08.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 -- 172.21.15.112:0/3620103015 shutdown_connections 2020-11-20T11:18:08.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3620103015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f41512e0 0x7f83f4151710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3620103015 >> v2:172.21.15.166:3300/0 conn(0x7f83f4066110 0x7f83f40bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 -- 172.21.15.112:0/3620103015 >> 172.21.15.112:0/3620103015 conn(0x7f83f405bac0 msgr2=0x7f83f405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.229 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 -- 172.21.15.112:0/3620103015 shutdown_connections 2020-11-20T11:18:08.229 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.221+0000 7f83fa03a700 1 -- 172.21.15.112:0/3620103015 wait complete. 2020-11-20T11:18:08.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.222+0000 7f83fa03a700 1 Processor -- start 2020-11-20T11:18:08.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.222+0000 7f83fa03a700 1 -- start start 2020-11-20T11:18:08.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f83f4065d30 0x7f83f414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 0x7f83f40b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83f41512e0 0x7f83f4060910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4160710 con 0x7f83f4066110 2020-11-20T11:18:08.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41609b0 con 0x7f83f4065d30 2020-11-20T11:18:08.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83fa03a700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4160c50 con 0x7f83f41512e0 2020-11-20T11:18:08.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 0x7f83f40b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 0x7f83f40b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50708/0 (socket says 172.21.15.112:50708) 2020-11-20T11:18:08.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 -- 172.21.15.112:0/3734579189 learned_addr learned my addr 172.21.15.112:0/3734579189 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f37fe700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f83f4065d30 0x7f83f414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f3fff700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83f41512e0 0x7f83f4060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 -- 172.21.15.112:0/3734579189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83f41512e0 msgr2=0x7f83f4060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83f41512e0 0x7f83f4060910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 -- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f83f4065d30 msgr2=0x7f83f414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f83f4065d30 0x7f83f414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.223+0000 7f83f2ffd700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4160ef0 con 0x7f83f4066110 2020-11-20T11:18:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83f2ffd700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 0x7f83f40b2370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f83e800a920 tx=0x7f83e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e800e540 con 0x7f83f4066110 2020-11-20T11:18:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e800c030 con 0x7f83f4066110 2020-11-20T11:18:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4161190 con 0x7f83f4066110 2020-11-20T11:18:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e800e8d0 con 0x7f83f4066110 2020-11-20T11:18:08.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f40b0dc0 con 0x7f83f4066110 2020-11-20T11:18:08.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.224+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f40666e0 con 0x7f83f4066110 2020-11-20T11:18:08.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.225+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f83e8023070 con 0x7f83f4066110 2020-11-20T11:18:08.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83d37fe700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f83cc0806a0 0x7f83cc082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f83e80a2d60 con 0x7f83f4066110 2020-11-20T11:18:08.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83f37fe700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f83cc0806a0 0x7f83cc082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83d37fe700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7f83cc0893d0 0x7f83cc08b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83cc08be50 con 0x7f83cc0893d0 2020-11-20T11:18:08.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e80a30d0 con 0x7f83f4066110 2020-11-20T11:18:08.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83f3fff700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7f83cc0893d0 0x7f83cc08b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.226+0000 7f83f37fe700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f83cc0806a0 0x7f83cc082b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f83e400c8c0 tx=0x7f83e4008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.227+0000 7f83f3fff700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7f83cc0893d0 0x7f83cc08b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.227+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== osd.1 v2:172.21.15.166:6802/22858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f83cc08be50 con 0x7f83cc0893d0 2020-11-20T11:18:08.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.241+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 --> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83f4161320 con 0x7f83cc0893d0 2020-11-20T11:18:08.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.241+0000 7f83d37fe700 1 -- 172.21.15.112:0/3734579189 <== osd.1 v2:172.21.15.166:6802/22858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83f4161320 con 0x7f83cc0893d0 2020-11-20T11:18:08.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7f83cc0893d0 msgr2=0x7f83cc08b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7f83cc0893d0 0x7f83cc08b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f83cc0806a0 msgr2=0x7f83cc082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f83cc0806a0 0x7f83cc082b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f83e400c8c0 tx=0x7f83e4008040).stop 2020-11-20T11:18:08.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 msgr2=0x7f83f40b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 --2- 172.21.15.112:0/3734579189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4066110 0x7f83f40b2370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f83e800a920 tx=0x7f83e8008040).stop 2020-11-20T11:18:08.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83f3fff700 1 -- 172.21.15.112:0/3734579189 reap_dead start 2020-11-20T11:18:08.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 shutdown_connections 2020-11-20T11:18:08.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 >> 172.21.15.112:0/3734579189 conn(0x7f83f405bac0 msgr2=0x7f83f41503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 shutdown_connections 2020-11-20T11:18:08.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.242+0000 7f83fa03a700 1 -- 172.21.15.112:0/3734579189 wait complete. 2020-11-20T11:18:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:08.256 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T11:18:08.365 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.362+0000 7f078e8fc700 1 Processor -- start 2020-11-20T11:18:08.365 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.362+0000 7f078e8fc700 1 -- start start 2020-11-20T11:18:08.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f078e8fc700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0788152270 0x7f0788060a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f078e8fc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880bcad0 con 0x7f0788065d30 2020-11-20T11:18:08.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f078e8fc700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880bd2d0 con 0x7f0788066110 2020-11-20T11:18:08.369 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f078e8fc700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880bd570 con 0x7f0788152270 2020-11-20T11:18:08.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f0787fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0788065d30 0x7f07880bc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34910/0 (socket says 172.21.15.112:34910) 2020-11-20T11:18:08.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.363+0000 7f0787fff700 1 -- 172.21.15.112:0/2225143425 learned_addr learned my addr 172.21.15.112:0/2225143425 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:08.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357663773 0 0) 0x7f07880bcad0 con 0x7f0788065d30 2020-11-20T11:18:08.370 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f078ce99700 1 --2- 172.21.15.112:0/2225143425 >> v2:172.21.15.204:3300/0 conn(0x7f0788152270 0x7f0788060a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0774003280 con 0x7f0788065d30 2020-11-20T11:18:08.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3037636979 0 0) 0x7f0774003280 con 0x7f0788065d30 2020-11-20T11:18:08.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 >> v2:172.21.15.204:3300/0 conn(0x7f0788152270 msgr2=0x7f0788060a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 --2- 172.21.15.112:0/2225143425 >> v2:172.21.15.204:3300/0 conn(0x7f0788152270 0x7f0788060a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 >> v1:172.21.15.204:6789/0 conn(0x7f0788066110 legacy=0x7f0788151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880bd810 con 0x7f0788065d30 2020-11-20T11:18:08.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f0778001520 con 0x7f0788065d30 2020-11-20T11:18:08.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 >> v1:172.21.15.112:6789/0 conn(0x7f0788065d30 legacy=0x7f07880bc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 0x7f0774003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.372 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0774004520 0x7f07740049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0774004e90 0x7f077400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880bd570 con 0x7f07740037c0 2020-11-20T11:18:08.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740053f0 con 0x7f0774004e90 2020-11-20T11:18:08.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077400bce0 con 0x7f0774004520 2020-11-20T11:18:08.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 0x7f0774003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f07877fe700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0774004520 0x7f07740049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 -- 172.21.15.112:0/2225143425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0774004520 msgr2=0x7f07740049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0774004520 0x7f07740049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 -- 172.21.15.112:0/2225143425 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0774004e90 msgr2=0x7f077400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0774004e90 0x7f077400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:08.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f078ce99700 1 -- 172.21.15.112:0/2225143425 reap_dead start 2020-11-20T11:18:08.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 -- 172.21.15.112:0/2225143425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774003280 con 0x7f07740037c0 2020-11-20T11:18:08.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.364+0000 7f0787fff700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 0x7f0774003be0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f077800c440 tx=0x7f07880bd460).ready entity=mon.0 client_cookie=37d20fec20df5c6c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780072e0 con 0x7f07740037c0 2020-11-20T11:18:08.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778007440 con 0x7f07740037c0 2020-11-20T11:18:08.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f0786ffd700 1 -- 172.21.15.112:0/2225143425 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778005860 con 0x7f07740037c0 2020-11-20T11:18:08.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 -- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 msgr2=0x7f0774003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 0x7f0774003be0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f077800c440 tx=0x7f07880bd460).stop 2020-11-20T11:18:08.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 -- 172.21.15.112:0/2225143425 shutdown_connections 2020-11-20T11:18:08.376 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 --2- 172.21.15.112:0/2225143425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07740037c0 0x7f0774003be0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 -- 172.21.15.112:0/2225143425 >> 172.21.15.112:0/2225143425 conn(0x7f078805bac0 msgr2=0x7f078805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 -- 172.21.15.112:0/2225143425 shutdown_connections 2020-11-20T11:18:08.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.365+0000 7f078e8fc700 1 -- 172.21.15.112:0/2225143425 wait complete. 2020-11-20T11:18:08.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.366+0000 7f078e8fc700 1 Processor -- start 2020-11-20T11:18:08.377 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.366+0000 7f078e8fc700 1 -- start start 2020-11-20T11:18:08.380 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07740037c0 0x7f078815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 0x7f078814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0788160b40 0x7f0788150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881619f0 con 0x7f078814bef0 2020-11-20T11:18:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881614b0 con 0x7f0788160b40 2020-11-20T11:18:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078e8fc700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788161750 con 0x7f07740037c0 2020-11-20T11:18:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 0x7f078814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 0x7f078814c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50728/0 (socket says 172.21.15.112:50728) 2020-11-20T11:18:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 -- 172.21.15.112:0/2266518641 learned_addr learned my addr 172.21.15.112:0/2266518641 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f0787fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07740037c0 0x7f078815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 -- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07740037c0 msgr2=0x7f078815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078ce99700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0788160b40 0x7f0788150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07740037c0 0x7f078815e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 -- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0788160b40 msgr2=0x7f0788150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0788160b40 0x7f0788150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f07877fe700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078815d680 con 0x7f078814bef0 2020-11-20T11:18:08.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f0787fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07740037c0 0x7f078815e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:08.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.367+0000 7f078ce99700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f0788160b40 0x7f0788150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:08.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f07877fe700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 0x7f078814c6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f077c00e8e0 tx=0x7f077c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c007e70 con 0x7f078814bef0 2020-11-20T11:18:08.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00ee20 con 0x7f078814bef0 2020-11-20T11:18:08.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078815d920 con 0x7f078814bef0 2020-11-20T11:18:08.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00c990 con 0x7f078814bef0 2020-11-20T11:18:08.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078814cbb0 con 0x7f078814bef0 2020-11-20T11:18:08.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.368+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07880bd9f0 con 0x7f078814bef0 2020-11-20T11:18:08.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.369+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f077c025070 con 0x7f078814bef0 2020-11-20T11:18:08.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0767fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0760080670 0x7f0760082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f077c0a3170 con 0x7f078814bef0 2020-11-20T11:18:08.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0767fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f07600893a0 0x7f076008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f076008be20 con 0x7f07600893a0 2020-11-20T11:18:08.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f077c0a3460 con 0x7f078814bef0 2020-11-20T11:18:08.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0787fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0760080670 0x7f0760082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f078ce99700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f07600893a0 0x7f076008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.370+0000 7f0787fff700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0760080670 0x7f0760082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0778007940 tx=0x7f0778013000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.371+0000 7f078ce99700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f07600893a0 0x7f076008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.389 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.371+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== osd.2 v2:172.21.15.204:6800/23308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f076008be20 con 0x7f07600893a0 2020-11-20T11:18:08.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.385+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 --> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f078815dd80 con 0x7f07600893a0 2020-11-20T11:18:08.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f0767fff700 1 -- 172.21.15.112:0/2266518641 <== osd.2 v2:172.21.15.204:6800/23308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f078815dd80 con 0x7f07600893a0 2020-11-20T11:18:08.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f07600893a0 msgr2=0x7f076008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f07600893a0 0x7f076008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0760080670 msgr2=0x7f0760082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0760080670 0x7f0760082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0778007940 tx=0x7f0778013000).stop 2020-11-20T11:18:08.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 msgr2=0x7f078814c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 --2- 172.21.15.112:0/2266518641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078814bef0 0x7f078814c6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f077c00e8e0 tx=0x7f077c009040).stop 2020-11-20T11:18:08.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078ce99700 1 -- 172.21.15.112:0/2266518641 reap_dead start 2020-11-20T11:18:08.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 shutdown_connections 2020-11-20T11:18:08.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 >> 172.21.15.112:0/2266518641 conn(0x7f078805bac0 msgr2=0x7f078814fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 shutdown_connections 2020-11-20T11:18:08.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.386+0000 7f078e8fc700 1 -- 172.21.15.112:0/2266518641 wait complete. 2020-11-20T11:18:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:08.400 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T11:18:08.510 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.508+0000 7f62fd81e700 1 Processor -- start 2020-11-20T11:18:08.510 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.508+0000 7f62fd81e700 1 -- start start 2020-11-20T11:18:08.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62fd81e700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 0x7f62f80bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62fd81e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f62f81512e0 0x7f62f8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62fd81e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80c5230 con 0x7f62f8065d30 2020-11-20T11:18:08.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62fd81e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f80bff40 con 0x7f62f81512e0 2020-11-20T11:18:08.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62fd81e700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f81549c0 con 0x7f62f8066110 2020-11-20T11:18:08.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62f77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f62f81512e0 0x7f62f8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62f77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f62f81512e0 0x7f62f8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50740/0 (socket says 172.21.15.112:50740) 2020-11-20T11:18:08.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62f77fe700 1 -- 172.21.15.112:0/591552450 learned_addr learned my addr 172.21.15.112:0/591552450 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62f6ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f62f8065d30 0x7f62f80c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34932/0 (socket says 172.21.15.112:34932) 2020-11-20T11:18:08.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.509+0000 7f62effff700 1 --2- 172.21.15.112:0/591552450 >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 0x7f62f80bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f77fe700 1 -- 172.21.15.112:0/591552450 >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 msgr2=0x7f62f80bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f77fe700 1 --2- 172.21.15.112:0/591552450 >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 0x7f62f80bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f77fe700 1 -- 172.21.15.112:0/591552450 >> v1:172.21.15.112:6789/0 conn(0x7f62f8065d30 legacy=0x7f62f80c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f77fe700 1 -- 172.21.15.112:0/591552450 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8154c60 con 0x7f62f81512e0 2020-11-20T11:18:08.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f67fc700 1 -- 172.21.15.112:0/591552450 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880949494 0 0) 0x7f62f80c5230 con 0x7f62f8065d30 2020-11-20T11:18:08.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62effff700 1 --2- 172.21.15.112:0/591552450 >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 0x7f62f80bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:08.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f77fe700 1 --2- 172.21.15.112:0/591552450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f81512e0 0x7f62f8151710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f62f80651b0 tx=0x7f62f00092d0).ready entity=mon.0 client_cookie=72d30f00b1b155ab server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f67fc700 1 -- 172.21.15.112:0/591552450 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000bbf0 con 0x7f62f81512e0 2020-11-20T11:18:08.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f67fc700 1 -- 172.21.15.112:0/591552450 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000bd50 con 0x7f62f81512e0 2020-11-20T11:18:08.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62f67fc700 1 -- 172.21.15.112:0/591552450 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0011610 con 0x7f62f81512e0 2020-11-20T11:18:08.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 -- 172.21.15.112:0/591552450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f81512e0 msgr2=0x7f62f8151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 --2- 172.21.15.112:0/591552450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f81512e0 0x7f62f8151710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f62f80651b0 tx=0x7f62f00092d0).stop 2020-11-20T11:18:08.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 -- 172.21.15.112:0/591552450 shutdown_connections 2020-11-20T11:18:08.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 --2- 172.21.15.112:0/591552450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f81512e0 0x7f62f8151710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 --2- 172.21.15.112:0/591552450 >> v2:172.21.15.204:3300/0 conn(0x7f62f8066110 0x7f62f80bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 -- 172.21.15.112:0/591552450 >> 172.21.15.112:0/591552450 conn(0x7f62f805bac0 msgr2=0x7f62f805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 -- 172.21.15.112:0/591552450 shutdown_connections 2020-11-20T11:18:08.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.510+0000 7f62fd81e700 1 -- 172.21.15.112:0/591552450 wait complete. 2020-11-20T11:18:08.519 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.511+0000 7f62fd81e700 1 Processor -- start 2020-11-20T11:18:08.519 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.511+0000 7f62fd81e700 1 -- start start 2020-11-20T11:18:08.521 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 0x7f62f8060fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.521 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f62f8066110 0x7f62f81638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62f81512e0 0x7f62f8067140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8157460 con 0x7f62f8065d30 2020-11-20T11:18:08.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8157700 con 0x7f62f8066110 2020-11-20T11:18:08.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62fd81e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81579a0 con 0x7f62f81512e0 2020-11-20T11:18:08.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62f6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 0x7f62f8060fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62f6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 0x7f62f8060fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50742/0 (socket says 172.21.15.112:50742) 2020-11-20T11:18:08.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.512+0000 7f62f6ffd700 1 -- 172.21.15.112:0/3912513270 learned_addr learned my addr 172.21.15.112:0/3912513270 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 -- 172.21.15.112:0/3912513270 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62f81512e0 msgr2=0x7f62f8067140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62effff700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f62f8066110 0x7f62f81638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62f81512e0 0x7f62f8067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:08.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 -- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f62f8066110 msgr2=0x7f62f81638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f62f8066110 0x7f62f81638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8157c40 con 0x7f62f8065d30 2020-11-20T11:18:08.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62f6ffd700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 0x7f62f8060fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f62e800c760 tx=0x7f62e8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8007320 con 0x7f62f8065d30 2020-11-20T11:18:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8005570 con 0x7f62f8065d30 2020-11-20T11:18:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f8157ee0 con 0x7f62f8065d30 2020-11-20T11:18:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8005930 con 0x7f62f8065d30 2020-11-20T11:18:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.513+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f8150fe0 con 0x7f62f8065d30 2020-11-20T11:18:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.514+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62f80666e0 con 0x7f62f8065d30 2020-11-20T11:18:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f62e8010030 con 0x7f62f8065d30 2020-11-20T11:18:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f62d4080670 0x7f62d4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f62e80a2760 con 0x7f62f8065d30 2020-11-20T11:18:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7f62d40893a0 0x7f62d408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62d408be20 con 0x7f62d40893a0 2020-11-20T11:18:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62e80a4d40 con 0x7f62f8065d30 2020-11-20T11:18:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62effff700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f62d4080670 0x7f62d4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.515+0000 7f62f77fe700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7f62d40893a0 0x7f62d408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.516+0000 7f62effff700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f62d4080670 0x7f62d4082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f62e0006c10 tx=0x7f62e0008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.516+0000 7f62f77fe700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7f62d40893a0 0x7f62d408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.516+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== osd.3 v2:172.21.15.112:6808/23141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f62d408be20 con 0x7f62d40893a0 2020-11-20T11:18:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.530+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 --> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62f8066e60 con 0x7f62d40893a0 2020-11-20T11:18:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.530+0000 7f62eeffd700 1 -- 172.21.15.112:0/3912513270 <== osd.3 v2:172.21.15.112:6808/23141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62f8066e60 con 0x7f62d40893a0 2020-11-20T11:18:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7f62d40893a0 msgr2=0x7f62d408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7f62d40893a0 0x7f62d408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f62d4080670 msgr2=0x7f62d4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f62d4080670 0x7f62d4082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f62e0006c10 tx=0x7f62e0008040).stop 2020-11-20T11:18:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 msgr2=0x7f62f8060fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 --2- 172.21.15.112:0/3912513270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f8065d30 0x7f62f8060fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f62e800c760 tx=0x7f62e8007c70).stop 2020-11-20T11:18:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62f77fe700 1 -- 172.21.15.112:0/3912513270 reap_dead start 2020-11-20T11:18:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 shutdown_connections 2020-11-20T11:18:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 >> 172.21.15.112:0/3912513270 conn(0x7f62f805bac0 msgr2=0x7f62f80c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 shutdown_connections 2020-11-20T11:18:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.531+0000 7f62fd81e700 1 -- 172.21.15.112:0/3912513270 wait complete. 2020-11-20T11:18:08.543 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:08.544 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T11:18:08.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.651+0000 7fab14c8a700 1 Processor -- start 2020-11-20T11:18:08.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 -- start start 2020-11-20T11:18:08.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fab10065d30 0x7fab10066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab101512e0 0x7fab10151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100c5230 con 0x7fab100bfa50 2020-11-20T11:18:08.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab101549c0 con 0x7fab101512e0 2020-11-20T11:18:08.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.652+0000 7fab14c8a700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab10154c60 con 0x7fab10065d30 2020-11-20T11:18:08.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab101512e0 0x7fab10151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab101512e0 0x7fab10151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50754/0 (socket says 172.21.15.112:50754) 2020-11-20T11:18:08.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 -- 172.21.15.112:0/3891495924 learned_addr learned my addr 172.21.15.112:0/3891495924 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0e59c700 1 --2- 172.21.15.112:0/3891495924 >> v2:172.21.15.204:3300/0 conn(0x7fab10065d30 0x7fab10066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 -- 172.21.15.112:0/3891495924 >> v2:172.21.15.204:3300/0 conn(0x7fab10065d30 msgr2=0x7fab10066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3891495924 >> v2:172.21.15.204:3300/0 conn(0x7fab10065d30 0x7fab10066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 -- 172.21.15.112:0/3891495924 >> v1:172.21.15.204:6789/0 conn(0x7fab100bfa50 legacy=0x7fab100c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 -- 172.21.15.112:0/3891495924 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10154f00 con 0x7fab101512e0 2020-11-20T11:18:08.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3891495924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab101512e0 0x7fab10151710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fab100c79a0 tx=0x7fab080092d0).ready entity=mon.0 client_cookie=b6e59e94de88dede server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0dd9b700 1 -- 172.21.15.112:0/3891495924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800bbf0 con 0x7fab101512e0 2020-11-20T11:18:08.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0dd9b700 1 -- 172.21.15.112:0/3891495924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800bd50 con 0x7fab101512e0 2020-11-20T11:18:08.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab0dd9b700 1 -- 172.21.15.112:0/3891495924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08011610 con 0x7fab101512e0 2020-11-20T11:18:08.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab14c8a700 1 -- 172.21.15.112:0/3891495924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab101512e0 msgr2=0x7fab10151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.653+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3891495924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab101512e0 0x7fab10151710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fab100c79a0 tx=0x7fab080092d0).stop 2020-11-20T11:18:08.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 -- 172.21.15.112:0/3891495924 shutdown_connections 2020-11-20T11:18:08.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3891495924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab101512e0 0x7fab10151710 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3891495924 >> v2:172.21.15.204:3300/0 conn(0x7fab10065d30 0x7fab10066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 -- 172.21.15.112:0/3891495924 >> 172.21.15.112:0/3891495924 conn(0x7fab1005bac0 msgr2=0x7fab1005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 -- 172.21.15.112:0/3891495924 shutdown_connections 2020-11-20T11:18:08.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.654+0000 7fab14c8a700 1 -- 172.21.15.112:0/3891495924 wait complete. 2020-11-20T11:18:08.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 Processor -- start 2020-11-20T11:18:08.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 -- start start 2020-11-20T11:18:08.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab10065d30 0x7fab101542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 0x7fab1014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fab101512e0 0x7fab10164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab101529f0 con 0x7fab100bfa50 2020-11-20T11:18:08.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab101651c0 con 0x7fab101512e0 2020-11-20T11:18:08.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.655+0000 7fab14c8a700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100b0810 con 0x7fab10065d30 2020-11-20T11:18:08.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 0x7fab1014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 0x7fab1014c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50758/0 (socket says 172.21.15.112:50758) 2020-11-20T11:18:08.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 -- 172.21.15.112:0/3118698703 learned_addr learned my addr 172.21.15.112:0/3118698703 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab0e59c700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab10065d30 0x7fab101542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fab101512e0 0x7fab10164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 -- 172.21.15.112:0/3118698703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab10065d30 msgr2=0x7fab101542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab10065d30 0x7fab101542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 -- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fab101512e0 msgr2=0x7fab10164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fab101512e0 0x7fab10164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100b0a70 con 0x7fab100bfa50 2020-11-20T11:18:08.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fab101512e0 0x7fab10164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:08.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab07fff700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 0x7fab1014c290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7faaf800c710 tx=0x7faaf8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800e4a0 con 0x7fab100bfa50 2020-11-20T11:18:08.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800e600 con 0x7fab100bfa50 2020-11-20T11:18:08.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800e9a0 con 0x7fab100bfa50 2020-11-20T11:18:08.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab100b0d10 con 0x7fab100bfa50 2020-11-20T11:18:08.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.656+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab10152c20 con 0x7fab100bfa50 2020-11-20T11:18:08.673 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.657+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab1005c410 con 0x7fab100bfa50 2020-11-20T11:18:08.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7faaf8010030 con 0x7fab100bfa50 2020-11-20T11:18:08.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7faaec080670 0x7faaec082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7faaf80a3040 con 0x7fab100bfa50 2020-11-20T11:18:08.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7faaec0893a0 0x7faaec08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaec08be20 con 0x7faaec0893a0 2020-11-20T11:18:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaf80a33b0 con 0x7fab100bfa50 2020-11-20T11:18:08.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab0e59c700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7faaec080670 0x7faaec082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.658+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7faaec0893a0 0x7faaec08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.659+0000 7fab0e59c700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7faaec080670 0x7faaec082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab00006fd0 tx=0x7fab00006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.659+0000 7fab0ed9d700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7faaec0893a0 0x7faaec08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.660+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== osd.4 v2:172.21.15.166:6821/22859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7faaec08be20 con 0x7faaec0893a0 2020-11-20T11:18:08.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.673+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 --> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab100657e0 con 0x7faaec0893a0 2020-11-20T11:18:08.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab067fc700 1 -- 172.21.15.112:0/3118698703 <== osd.4 v2:172.21.15.166:6821/22859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab0800bec0 con 0x7faaec0893a0 2020-11-20T11:18:08.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7faaec0893a0 msgr2=0x7faaec08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7faaec0893a0 0x7faaec08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7faaec080670 msgr2=0x7faaec082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7faaec080670 0x7faaec082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab00006fd0 tx=0x7fab00006e30).stop 2020-11-20T11:18:08.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 msgr2=0x7fab1014c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 --2- 172.21.15.112:0/3118698703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab100bfa50 0x7fab1014c290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7faaf800c710 tx=0x7faaf8007c40).stop 2020-11-20T11:18:08.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab0ed9d700 1 -- 172.21.15.112:0/3118698703 reap_dead start 2020-11-20T11:18:08.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 shutdown_connections 2020-11-20T11:18:08.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 >> 172.21.15.112:0/3118698703 conn(0x7fab1005bac0 msgr2=0x7fab1014fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 shutdown_connections 2020-11-20T11:18:08.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.674+0000 7fab14c8a700 1 -- 172.21.15.112:0/3118698703 wait complete. 2020-11-20T11:18:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:08.687 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T11:18:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.796+0000 7fe35fefe700 1 Processor -- start 2020-11-20T11:18:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 -- start start 2020-11-20T11:18:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe358065d30 0x7fe358066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fe3580bfa50 0x7fe3580c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580c5230 con 0x7fe3580c4c60 2020-11-20T11:18:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3581549c0 con 0x7fe3580bfa50 2020-11-20T11:18:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.797+0000 7fe35fefe700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe358154c60 con 0x7fe358065d30 2020-11-20T11:18:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35e49b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe3580c4c60 0x7fe3581512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34966/0 (socket says 172.21.15.112:34966) 2020-11-20T11:18:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35e49b700 1 -- 172.21.15.112:0/4099057148 learned_addr learned my addr 172.21.15.112:0/4099057148 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931456985 0 0) 0x7fe3580c5230 con 0x7fe3580c4c60 2020-11-20T11:18:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 --2- 172.21.15.112:0/4099057148 >> v2:172.21.15.166:3300/0 conn(0x7fe3580bfa50 0x7fe3580c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003280 con 0x7fe3580c4c60 2020-11-20T11:18:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/4099057148 >> v2:172.21.15.204:3300/0 conn(0x7fe358065d30 0x7fe358066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 273133069 0 0) 0x7fe340003280 con 0x7fe3580c4c60 2020-11-20T11:18:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 >> v2:172.21.15.204:3300/0 conn(0x7fe358065d30 msgr2=0x7fe358066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 --2- 172.21.15.112:0/4099057148 >> v2:172.21.15.204:3300/0 conn(0x7fe358065d30 0x7fe358066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 >> v2:172.21.15.166:3300/0 conn(0x7fe3580bfa50 msgr2=0x7fe3580c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 --2- 172.21.15.112:0/4099057148 >> v2:172.21.15.166:3300/0 conn(0x7fe3580bfa50 0x7fe3580c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358154f00 con 0x7fe3580c4c60 2020-11-20T11:18:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fe3500018a0 con 0x7fe3580c4c60 2020-11-20T11:18:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 >> v1:172.21.15.112:6789/0 conn(0x7fe3580c4c60 legacy=0x7fe3581512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3400037c0 0x7fe340003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 0x7fe3400049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004e90 0x7fe34000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581549c0 con 0x7fe340004520 2020-11-20T11:18:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe358154c60 con 0x7fe3400037c0 2020-11-20T11:18:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400053f0 con 0x7fe340004e90 2020-11-20T11:18:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 0x7fe3400049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3400037c0 0x7fe340003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35e49b700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004e90 0x7fe34000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 -- 172.21.15.112:0/4099057148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004e90 msgr2=0x7fe34000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004e90 0x7fe34000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 -- 172.21.15.112:0/4099057148 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3400037c0 msgr2=0x7fe340003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3400037c0 0x7fe340003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35d499700 1 -- 172.21.15.112:0/4099057148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340003280 con 0x7fe340004520 2020-11-20T11:18:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.798+0000 7fe35e49b700 1 -- 172.21.15.112:0/4099057148 reap_dead start 2020-11-20T11:18:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35d499700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 0x7fe3400049a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe34800bc40 tx=0x7fe348006e30).ready entity=mon.0 client_cookie=f58fc9d68fdce986 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800b350 con 0x7fe340004520 2020-11-20T11:18:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800ea00 con 0x7fe340004520 2020-11-20T11:18:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35cc98700 1 -- 172.21.15.112:0/4099057148 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800ed80 con 0x7fe340004520 2020-11-20T11:18:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 -- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 msgr2=0x7fe3400049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 0x7fe3400049a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe34800bc40 tx=0x7fe348006e30).stop 2020-11-20T11:18:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 -- 172.21.15.112:0/4099057148 shutdown_connections 2020-11-20T11:18:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 --2- 172.21.15.112:0/4099057148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe340004520 0x7fe3400049a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 -- 172.21.15.112:0/4099057148 >> 172.21.15.112:0/4099057148 conn(0x7fe35805bac0 msgr2=0x7fe35805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 -- 172.21.15.112:0/4099057148 shutdown_connections 2020-11-20T11:18:08.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.799+0000 7fe35fefe700 1 -- 172.21.15.112:0/4099057148 wait complete. 2020-11-20T11:18:08.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.800+0000 7fe35fefe700 1 Processor -- start 2020-11-20T11:18:08.811 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.800+0000 7fe35fefe700 1 -- start start 2020-11-20T11:18:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004520 0x7fe3581611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 0x7fe3581645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3580c58c0 0x7fe358153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580b3410 con 0x7fe3580c8470 2020-11-20T11:18:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580b36b0 con 0x7fe3580c58c0 2020-11-20T11:18:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35fefe700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581607e0 con 0x7fe340004520 2020-11-20T11:18:08.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 0x7fe3581645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 0x7fe3581645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50782/0 (socket says 172.21.15.112:50782) 2020-11-20T11:18:08.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 -- 172.21.15.112:0/3696155970 learned_addr learned my addr 172.21.15.112:0/3696155970 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004520 0x7fe3581611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 -- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004520 msgr2=0x7fe3581611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004520 0x7fe3581611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35e49b700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3580c58c0 0x7fe358153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 -- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3580c58c0 msgr2=0x7fe358153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe3580c58c0 0x7fe358153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358160a80 con 0x7fe3580c8470 2020-11-20T11:18:08.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe340004520 0x7fe3581611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:08.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.801+0000 7fe35d499700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 0x7fe3581645c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe34800f010 tx=0x7fe348019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348012e20 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348000e90 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe358160d20 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348024640 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580b3090 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.802+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3580666e0 con 0x7fe3580c8470 2020-11-20T11:18:08.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.803+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe34802c3f0 con 0x7fe3580c8470 2020-11-20T11:18:08.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe345ffb700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe330080670 0x7fe330082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe3480a4320 con 0x7fe3580c8470 2020-11-20T11:18:08.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe345ffb700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7fe3300893a0 0x7fe33008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe33008be20 con 0x7fe3300893a0 2020-11-20T11:18:08.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3480a4690 con 0x7fe3580c8470 2020-11-20T11:18:08.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe330080670 0x7fe330082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe35e49b700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7fe3300893a0 0x7fe33008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.804+0000 7fe35dc9a700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe330080670 0x7fe330082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe354006fd0 tx=0x7fe354008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.805+0000 7fe35e49b700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7fe3300893a0 0x7fe33008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.806+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== osd.5 v2:172.21.15.204:6808/23309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fe33008be20 con 0x7fe3300893a0 2020-11-20T11:18:08.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.819+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 --> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe358065740 con 0x7fe3300893a0 2020-11-20T11:18:08.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.820+0000 7fe345ffb700 1 -- 172.21.15.112:0/3696155970 <== osd.5 v2:172.21.15.204:6808/23309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe358065740 con 0x7fe3300893a0 2020-11-20T11:18:08.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.820+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7fe3300893a0 msgr2=0x7fe33008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.820+0000 7fe35fefe700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7fe3300893a0 0x7fe33008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe330080670 msgr2=0x7fe330082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe330080670 0x7fe330082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe354006fd0 tx=0x7fe354008040).stop 2020-11-20T11:18:08.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 msgr2=0x7fe3581645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 --2- 172.21.15.112:0/3696155970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3580c8470 0x7fe3581645c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe34800f010 tx=0x7fe348019000).stop 2020-11-20T11:18:08.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35e49b700 1 -- 172.21.15.112:0/3696155970 reap_dead start 2020-11-20T11:18:08.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 shutdown_connections 2020-11-20T11:18:08.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 >> 172.21.15.112:0/3696155970 conn(0x7fe35805bac0 msgr2=0x7fe35814df30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 shutdown_connections 2020-11-20T11:18:08.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.821+0000 7fe35fefe700 1 -- 172.21.15.112:0/3696155970 wait complete. 2020-11-20T11:18:08.833 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:08.834 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T11:18:08.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.942+0000 7f16a78c5700 1 Processor -- start 2020-11-20T11:18:08.945 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.942+0000 7f16a78c5700 1 -- start start 2020-11-20T11:18:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a78c5700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f16a014af80 0x7f16a0064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a78c5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a014d8a0 con 0x7f16a0060f10 2020-11-20T11:18:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a78c5700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a0151110 con 0x7f16a0064b90 2020-11-20T11:18:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a78c5700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a01513b0 con 0x7f16a014af80 2020-11-20T11:18:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a4e60700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16a0060f10 0x7f16a014a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34986/0 (socket says 172.21.15.112:34986) 2020-11-20T11:18:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.943+0000 7f16a4e60700 1 -- 172.21.15.112:0/2308284861 learned_addr learned my addr 172.21.15.112:0/2308284861 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424992143 0 0) 0x7f16a014d8a0 con 0x7f16a0060f10 2020-11-20T11:18:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1688003280 con 0x7f16a0060f10 2020-11-20T11:18:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5e62700 1 --2- 172.21.15.112:0/2308284861 >> v2:172.21.15.166:3300/0 conn(0x7f16a014af80 0x7f16a0064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1606692370 0 0) 0x7f1688003280 con 0x7f16a0060f10 2020-11-20T11:18:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 >> v2:172.21.15.166:3300/0 conn(0x7f16a014af80 msgr2=0x7f16a0064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 --2- 172.21.15.112:0/2308284861 >> v2:172.21.15.166:3300/0 conn(0x7f16a014af80 0x7f16a0064f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 >> v1:172.21.15.204:6789/0 conn(0x7f16a0064b90 legacy=0x7f16a00bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0151650 con 0x7f16a0060f10 2020-11-20T11:18:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f1690001520 con 0x7f16a0060f10 2020-11-20T11:18:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 >> v1:172.21.15.112:6789/0 conn(0x7f16a0060f10 legacy=0x7f16a014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f1688003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1688004520 0x7f16880049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004e90 0x7f168800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a01513b0 con 0x7f16880037c0 2020-11-20T11:18:08.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688005370 con 0x7f1688004520 2020-11-20T11:18:08.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168800cd70 con 0x7f1688004e90 2020-11-20T11:18:08.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5e62700 1 --2- 172.21.15.112:0/2308284861 >> v2:172.21.15.166:3300/0 conn(0x7f16a014af80 0x7f16a0064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:08.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f1688003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a4e60700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1688004520 0x7f16880049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5e62700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004e90 0x7f168800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 -- 172.21.15.112:0/2308284861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004e90 msgr2=0x7f168800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004e90 0x7f168800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 -- 172.21.15.112:0/2308284861 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1688004520 msgr2=0x7f16880049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:08.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1688004520 0x7f16880049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5e62700 1 -- 172.21.15.112:0/2308284861 reap_dead start 2020-11-20T11:18:08.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.944+0000 7f16a5661700 1 -- 172.21.15.112:0/2308284861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688003280 con 0x7f16880037c0 2020-11-20T11:18:08.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a5661700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f1688003be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f169c001990 tx=0x7f169c007bd0).ready entity=mon.0 client_cookie=6e06454b8347636d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c007020 con 0x7f16880037c0 2020-11-20T11:18:08.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c007180 con 0x7f16880037c0 2020-11-20T11:18:08.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f168ffff700 1 -- 172.21.15.112:0/2308284861 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00c650 con 0x7f16880037c0 2020-11-20T11:18:08.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 -- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 msgr2=0x7f1688003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f1688003be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f169c001990 tx=0x7f169c007bd0).stop 2020-11-20T11:18:08.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 -- 172.21.15.112:0/2308284861 shutdown_connections 2020-11-20T11:18:08.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 --2- 172.21.15.112:0/2308284861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f1688003be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 -- 172.21.15.112:0/2308284861 >> 172.21.15.112:0/2308284861 conn(0x7f16a005bac0 msgr2=0x7f16a005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 -- 172.21.15.112:0/2308284861 shutdown_connections 2020-11-20T11:18:08.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.945+0000 7f16a78c5700 1 -- 172.21.15.112:0/2308284861 wait complete. 2020-11-20T11:18:08.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.946+0000 7f16a78c5700 1 Processor -- start 2020-11-20T11:18:08.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.946+0000 7f16a78c5700 1 -- start start 2020-11-20T11:18:08.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f16a00ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16a0145d80 0x7f16a0067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a0149bf0 0x7f16a0144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0146580 con 0x7f16880037c0 2020-11-20T11:18:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00677f0 con 0x7f16a0145d80 2020-11-20T11:18:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a78c5700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00aeee0 con 0x7f16a0149bf0 2020-11-20T11:18:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a5661700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f16a00ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a5661700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f16a00ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50802/0 (socket says 172.21.15.112:50802) 2020-11-20T11:18:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a5661700 1 -- 172.21.15.112:0/3345284031 learned_addr learned my addr 172.21.15.112:0/3345284031 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.947+0000 7f16a5e62700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a0149bf0 0x7f16a0144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 -- 172.21.15.112:0/3345284031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a0149bf0 msgr2=0x7f16a0144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a0149bf0 0x7f16a0144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a4e60700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16a0145d80 0x7f16a0067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 -- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16a0145d80 msgr2=0x7f16a0067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16a0145d80 0x7f16a0067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00aec40 con 0x7f16880037c0 2020-11-20T11:18:08.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a4e60700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16a0145d80 0x7f16a0067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:08.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a5661700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f16a00ae5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1688005340 tx=0x7f169c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0138c0 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c013a40 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c013e00 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a015e4c0 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.948+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a015ea00 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.949+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16a0067970 con 0x7f16880037c0 2020-11-20T11:18:08.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.949+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f169c025020 con 0x7f16880037c0 2020-11-20T11:18:08.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f168d7fa700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16780806a0 0x7f1678082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f169c0a3e50 con 0x7f16880037c0 2020-11-20T11:18:08.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f168d7fa700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f16780893d0 0x7f167808b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:08.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f167808be50 con 0x7f16780893d0 2020-11-20T11:18:08.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f169c0a41c0 con 0x7f16880037c0 2020-11-20T11:18:08.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f16a4e60700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16780806a0 0x7f1678082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f16a5e62700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f16780893d0 0x7f167808b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:08.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f16a5e62700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f16780893d0 0x7f167808b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.950+0000 7f16a4e60700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16780806a0 0x7f1678082b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1690000c00 tx=0x7f1690009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:08.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.951+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== osd.6 v2:172.21.15.112:6816/23142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f167808be50 con 0x7f16780893d0 2020-11-20T11:18:08.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 --> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16a0146580 con 0x7f16780893d0 2020-11-20T11:18:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f168d7fa700 1 -- 172.21.15.112:0/3345284031 <== osd.6 v2:172.21.15.112:6816/23142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16a0146580 con 0x7f16780893d0 2020-11-20T11:18:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f16780893d0 msgr2=0x7f167808b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f16780893d0 0x7f167808b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16780806a0 msgr2=0x7f1678082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16780806a0 0x7f1678082b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1690000c00 tx=0x7f1690009040).stop 2020-11-20T11:18:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 msgr2=0x7f16a00ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a78c5700 1 --2- 172.21.15.112:0/3345284031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16880037c0 0x7f16a00ae5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1688005340 tx=0x7f169c015000).stop 2020-11-20T11:18:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.965+0000 7f16a5e62700 1 -- 172.21.15.112:0/3345284031 reap_dead start 2020-11-20T11:18:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.966+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 shutdown_connections 2020-11-20T11:18:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.966+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 >> 172.21.15.112:0/3345284031 conn(0x7f16a005bac0 msgr2=0x7f16a00bf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.966+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 shutdown_connections 2020-11-20T11:18:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:08.966+0000 7f16a78c5700 1 -- 172.21.15.112:0/3345284031 wait complete. 2020-11-20T11:18:08.978 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:08.978 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T11:18:09.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 Processor -- start 2020-11-20T11:18:09.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 -- start start 2020-11-20T11:18:09.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fc2800c4fa0 0x7fc28005c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.090 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2800c4d40 con 0x7fc28005bc80 2020-11-20T11:18:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc280154cc0 con 0x7fc280151880 2020-11-20T11:18:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.086+0000 7fc2859f4700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc280154f60 con 0x7fc2800c4fa0 2020-11-20T11:18:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27f7fe700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc280151880 0x7fc280151d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:45136/0 (socket says 172.21.15.112:45136) 2020-11-20T11:18:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27f7fe700 1 -- 172.21.15.112:0/719362282 learned_addr learned my addr 172.21.15.112:0/719362282 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27e7fc700 1 --2- 172.21.15.112:0/719362282 >> v2:172.21.15.166:3300/0 conn(0x7fc2800c4fa0 0x7fc28005c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231049489 0 0) 0x7fc280154cc0 con 0x7fc280151880 2020-11-20T11:18:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc26c003280 con 0x7fc280151880 2020-11-20T11:18:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27e7fc700 1 -- 172.21.15.112:0/719362282 >> v1:172.21.15.204:6789/0 conn(0x7fc280151880 legacy=0x7fc280151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460077912 0 0) 0x7fc2800c4d40 con 0x7fc28005bc80 2020-11-20T11:18:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27e7fc700 1 -- 172.21.15.112:0/719362282 >> v1:172.21.15.166:6789/0 conn(0x7fc28005bc80 legacy=0x7fc2800bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27e7fc700 1 -- 172.21.15.112:0/719362282 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280155200 con 0x7fc2800c4fa0 2020-11-20T11:18:09.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27e7fc700 1 --2- 172.21.15.112:0/719362282 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc2800c4fa0 0x7fc28005c060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc274006fd0 tx=0x7fc274006e30).ready entity=mon.1 client_cookie=929791226f16fd62 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400bec0 con 0x7fc2800c4fa0 2020-11-20T11:18:09.093 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274000e90 con 0x7fc2800c4fa0 2020-11-20T11:18:09.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.087+0000 7fc27dffb700 1 -- 172.21.15.112:0/719362282 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740099f0 con 0x7fc2800c4fa0 2020-11-20T11:18:09.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 -- 172.21.15.112:0/719362282 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc2800c4fa0 msgr2=0x7fc28005c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 --2- 172.21.15.112:0/719362282 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc2800c4fa0 0x7fc28005c060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc274006fd0 tx=0x7fc274006e30).stop 2020-11-20T11:18:09.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 -- 172.21.15.112:0/719362282 shutdown_connections 2020-11-20T11:18:09.094 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 --2- 172.21.15.112:0/719362282 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc2800c4fa0 0x7fc28005c060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 -- 172.21.15.112:0/719362282 >> 172.21.15.112:0/719362282 conn(0x7fc280060820 msgr2=0x7fc2800624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 -- 172.21.15.112:0/719362282 shutdown_connections 2020-11-20T11:18:09.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.088+0000 7fc2859f4700 1 -- 172.21.15.112:0/719362282 wait complete. 2020-11-20T11:18:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.089+0000 7fc2859f4700 1 Processor -- start 2020-11-20T11:18:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.089+0000 7fc2859f4700 1 -- start start 2020-11-20T11:18:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 0x7fc280065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2800c4fa0 0x7fc28014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc280151880 0x7fc28014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2801615b0 con 0x7fc28005bc80 2020-11-20T11:18:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280163ce0 con 0x7fc280151880 2020-11-20T11:18:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc2859f4700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280163f80 con 0x7fc2800c4fa0 2020-11-20T11:18:09.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 0x7fc280065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 0x7fc280065810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50818/0 (socket says 172.21.15.112:50818) 2020-11-20T11:18:09.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 -- 172.21.15.112:0/616520748 learned_addr learned my addr 172.21.15.112:0/616520748 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27e7fc700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2800c4fa0 0x7fc28014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27f7fe700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc280151880 0x7fc28014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 -- 172.21.15.112:0/616520748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2800c4fa0 msgr2=0x7fc28014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2800c4fa0 0x7fc28014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 -- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc280151880 msgr2=0x7fc28014d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc280151880 0x7fc28014d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280164220 con 0x7fc28005bc80 2020-11-20T11:18:09.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.090+0000 7fc27effd700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 0x7fc280065810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc27000c6f0 tx=0x7fc270007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270010510 con 0x7fc28005bc80 2020-11-20T11:18:09.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270010670 con 0x7fc28005bc80 2020-11-20T11:18:09.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2801644c0 con 0x7fc28005bc80 2020-11-20T11:18:09.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270010a30 con 0x7fc28005bc80 2020-11-20T11:18:09.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280156720 con 0x7fc28005bc80 2020-11-20T11:18:09.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.091+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2800008d0 con 0x7fc28005bc80 2020-11-20T11:18:09.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.092+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc270010070 con 0x7fc28005bc80 2020-11-20T11:18:09.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.092+0000 7fc266ffd700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc25c080670 0x7fc25c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc2700a32d0 con 0x7fc28005bc80 2020-11-20T11:18:09.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc27e7fc700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc25c080670 0x7fc25c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc266ffd700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7fc25c0893a0 0x7fc25c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc25c08be20 con 0x7fc25c0893a0 2020-11-20T11:18:09.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2700a3640 con 0x7fc28005bc80 2020-11-20T11:18:09.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc27e7fc700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc25c080670 0x7fc25c082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc274006fd0 tx=0x7fc274015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.093+0000 7fc27f7fe700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7fc25c0893a0 0x7fc25c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.094+0000 7fc27f7fe700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7fc25c0893a0 0x7fc25c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.095+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== osd.7 v2:172.21.15.166:6810/22860 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fc25c08be20 con 0x7fc25c0893a0 2020-11-20T11:18:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.108+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 --> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc280155ec0 con 0x7fc25c0893a0 2020-11-20T11:18:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.109+0000 7fc266ffd700 1 -- 172.21.15.112:0/616520748 <== osd.7 v2:172.21.15.166:6810/22860 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc280155ec0 con 0x7fc25c0893a0 2020-11-20T11:18:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7fc25c0893a0 msgr2=0x7fc25c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7fc25c0893a0 0x7fc25c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc25c080670 msgr2=0x7fc25c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc25c080670 0x7fc25c082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc274006fd0 tx=0x7fc274015000).stop 2020-11-20T11:18:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 msgr2=0x7fc280065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 --2- 172.21.15.112:0/616520748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc28005bc80 0x7fc280065810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc27000c6f0 tx=0x7fc270007b00).stop 2020-11-20T11:18:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc27f7fe700 1 -- 172.21.15.112:0/616520748 reap_dead start 2020-11-20T11:18:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 shutdown_connections 2020-11-20T11:18:09.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 >> 172.21.15.112:0/616520748 conn(0x7fc280060820 msgr2=0x7fc2800c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 shutdown_connections 2020-11-20T11:18:09.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.110+0000 7fc2859f4700 1 -- 172.21.15.112:0/616520748 wait complete. 2020-11-20T11:18:09.122 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:09.123 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T11:18:09.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.230+0000 7f68d8e49700 1 Processor -- start 2020-11-20T11:18:09.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.230+0000 7f68d8e49700 1 -- start start 2020-11-20T11:18:09.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d8e49700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f68d4065d30 0x7f68d4066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d8e49700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d40c5230 con 0x7f68d41512e0 2020-11-20T11:18:09.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d8e49700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d41549c0 con 0x7f68d40bfa50 2020-11-20T11:18:09.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d8e49700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d4154c60 con 0x7f68d4065d30 2020-11-20T11:18:09.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d2d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f68d41512e0 0x7f68d4151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35024/0 (socket says 172.21.15.112:35024) 2020-11-20T11:18:09.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d2d9d700 1 -- 172.21.15.112:0/1890704665 learned_addr learned my addr 172.21.15.112:0/1890704665 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:09.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673631407 0 0) 0x7f68d40c5230 con 0x7f68d41512e0 2020-11-20T11:18:09.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d259c700 1 --2- 172.21.15.112:0/1890704665 >> v2:172.21.15.166:3300/0 conn(0x7f68d4065d30 0x7f68d4066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b8003280 con 0x7f68d41512e0 2020-11-20T11:18:09.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804057607 0 0) 0x7f68d41549c0 con 0x7f68d40bfa50 2020-11-20T11:18:09.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d40c5230 con 0x7f68d40bfa50 2020-11-20T11:18:09.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2323722742 0 0) 0x7f68b8003280 con 0x7f68d41512e0 2020-11-20T11:18:09.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 >> v2:172.21.15.166:3300/0 conn(0x7f68d4065d30 msgr2=0x7f68d4066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 --2- 172.21.15.112:0/1890704665 >> v2:172.21.15.166:3300/0 conn(0x7f68d4065d30 0x7f68d4066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 >> v1:172.21.15.204:6789/0 conn(0x7f68d40bfa50 legacy=0x7f68d40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4154f00 con 0x7f68d41512e0 2020-11-20T11:18:09.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f68cc0018a0 con 0x7f68d41512e0 2020-11-20T11:18:09.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 >> v1:172.21.15.112:6789/0 conn(0x7f68d41512e0 legacy=0x7f68d4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 0x7f68b8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68b8004520 0x7f68b80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8004ee0 0x7f68b800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4154c60 con 0x7f68b8003950 2020-11-20T11:18:09.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b800bc90 con 0x7f68b8004520 2020-11-20T11:18:09.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b800be50 con 0x7f68b8004ee0 2020-11-20T11:18:09.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.231+0000 7f68d259c700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 0x7f68b8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d2d9d700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8004ee0 0x7f68b800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d1d9b700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68b8004520 0x7f68b80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 -- 172.21.15.112:0/1890704665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8004ee0 msgr2=0x7f68b800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8004ee0 0x7f68b800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 -- 172.21.15.112:0/1890704665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68b8004520 msgr2=0x7f68b80049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68b8004520 0x7f68b80049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 -- 172.21.15.112:0/1890704665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8003280 con 0x7f68b8003950 2020-11-20T11:18:09.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d2d9d700 1 -- 172.21.15.112:0/1890704665 reap_dead start 2020-11-20T11:18:09.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d259c700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 0x7f68b8003d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f68c800bc40 tx=0x7f68c8006e30).ready entity=mon.0 client_cookie=ea9366653c050af2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800b350 con 0x7f68b8003950 2020-11-20T11:18:09.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800eab0 con 0x7f68b8003950 2020-11-20T11:18:09.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d159a700 1 -- 172.21.15.112:0/1890704665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800ee30 con 0x7f68b8003950 2020-11-20T11:18:09.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 -- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 msgr2=0x7f68b8003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 0x7f68b8003d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f68c800bc40 tx=0x7f68c8006e30).stop 2020-11-20T11:18:09.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 -- 172.21.15.112:0/1890704665 shutdown_connections 2020-11-20T11:18:09.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 --2- 172.21.15.112:0/1890704665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b8003950 0x7f68b8003d50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 -- 172.21.15.112:0/1890704665 >> 172.21.15.112:0/1890704665 conn(0x7f68d405bac0 msgr2=0x7f68d405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 -- 172.21.15.112:0/1890704665 shutdown_connections 2020-11-20T11:18:09.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.232+0000 7f68d8e49700 1 -- 172.21.15.112:0/1890704665 wait complete. 2020-11-20T11:18:09.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 Processor -- start 2020-11-20T11:18:09.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 -- start start 2020-11-20T11:18:09.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8003950 0x7f68d4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68d41543b0 0x7f68d40b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 0x7f68d40b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4160ce0 con 0x7f68d4160770 2020-11-20T11:18:09.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4160f80 con 0x7f68d41543b0 2020-11-20T11:18:09.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d8e49700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4161220 con 0x7f68b8003950 2020-11-20T11:18:09.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 0x7f68d40b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 0x7f68d40b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50844/0 (socket says 172.21.15.112:50844) 2020-11-20T11:18:09.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d2d9d700 1 -- 172.21.15.112:0/2804960241 learned_addr learned my addr 172.21.15.112:0/2804960241 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.234+0000 7f68d259c700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8003950 0x7f68d4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 -- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8003950 msgr2=0x7f68d4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8003950 0x7f68d4153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 -- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68d41543b0 msgr2=0x7f68d40b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f68d41543b0 0x7f68d40b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:09.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d41614c0 con 0x7f68d4160770 2020-11-20T11:18:09.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d259c700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68b8003950 0x7f68d4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:09.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d2d9d700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 0x7f68d40b5ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f68cc000f80 tx=0x7f68d4155090).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00cb40 con 0x7f68d4160770 2020-11-20T11:18:09.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00cca0 con 0x7f68d4160770 2020-11-20T11:18:09.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d40b10d0 con 0x7f68d4160770 2020-11-20T11:18:09.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc014430 con 0x7f68d4160770 2020-11-20T11:18:09.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d414caf0 con 0x7f68d4160770 2020-11-20T11:18:09.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.235+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68d41616c0 con 0x7f68d4160770 2020-11-20T11:18:09.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.236+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f68cc01d450 con 0x7f68d4160770 2020-11-20T11:18:09.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68c27fc700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f68a8080670 0x7f68a8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f68cc0a2db0 con 0x7f68d4160770 2020-11-20T11:18:09.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68c27fc700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f68a80893a0 0x7f68a808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a808be20 con 0x7f68a80893a0 2020-11-20T11:18:09.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68cc0a3120 con 0x7f68d4160770 2020-11-20T11:18:09.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68d259c700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f68a8080670 0x7f68a8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68d259c700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f68a8080670 0x7f68a8082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f68c8006e70 tx=0x7f68c8019000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.237+0000 7f68d1d9b700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f68a80893a0 0x7f68a808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.238+0000 7f68d1d9b700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f68a80893a0 0x7f68a808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.239+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== osd.8 v2:172.21.15.204:6818/23310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f68a808be20 con 0x7f68a80893a0 2020-11-20T11:18:09.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.252+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 --> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68d41532b0 con 0x7f68a80893a0 2020-11-20T11:18:09.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68c27fc700 1 -- 172.21.15.112:0/2804960241 <== osd.8 v2:172.21.15.204:6818/23310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68d41532b0 con 0x7f68a80893a0 2020-11-20T11:18:09.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f68a80893a0 msgr2=0x7f68a808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f68a80893a0 0x7f68a808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f68a8080670 msgr2=0x7f68a8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f68a8080670 0x7f68a8082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f68c8006e70 tx=0x7f68c8019000).stop 2020-11-20T11:18:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 msgr2=0x7f68d40b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 --2- 172.21.15.112:0/2804960241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d4160770 0x7f68d40b5ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f68cc000f80 tx=0x7f68d4155090).stop 2020-11-20T11:18:09.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d2d9d700 1 -- 172.21.15.112:0/2804960241 reap_dead start 2020-11-20T11:18:09.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 shutdown_connections 2020-11-20T11:18:09.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 >> 172.21.15.112:0/2804960241 conn(0x7f68d405bac0 msgr2=0x7f68d405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 shutdown_connections 2020-11-20T11:18:09.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.253+0000 7f68d8e49700 1 -- 172.21.15.112:0/2804960241 wait complete. 2020-11-20T11:18:09.268 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:09.269 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T11:18:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.376+0000 7f3409951700 1 Processor -- start 2020-11-20T11:18:09.379 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 -- start start 2020-11-20T11:18:09.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3404065d30 0x7f3404066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 0x7f34040c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 0x7f34041512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040c5230 con 0x7f3404065d30 2020-11-20T11:18:09.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34041549c0 con 0x7f34040c4c60 2020-11-20T11:18:09.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3409951700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3404154c60 con 0x7f34040bfa50 2020-11-20T11:18:09.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.377+0000 7f3402ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3404065d30 0x7f3404066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3404065d30 0x7f3404066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50850/0 (socket says 172.21.15.112:50850) 2020-11-20T11:18:09.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 -- 172.21.15.112:0/2518219385 learned_addr learned my addr 172.21.15.112:0/2518219385 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f34037fe700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 0x7f34041512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f34027fc700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 0x7f34040c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 -- 172.21.15.112:0/2518219385 >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 msgr2=0x7f34040c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 0x7f34040c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 -- 172.21.15.112:0/2518219385 >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 msgr2=0x7f34041512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.384 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 0x7f34041512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 -- 172.21.15.112:0/2518219385 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404154f00 con 0x7f3404065d30 2020-11-20T11:18:09.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f34037fe700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 0x7f34041512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:09.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f34027fc700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 0x7f34040c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:09.385 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3402ffd700 1 --2- 172.21.15.112:0/2518219385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3404065d30 0x7f3404066110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f34040651b0 tx=0x7f33f4006ef0).ready entity=mon.0 client_cookie=29947889fe9a23d7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3401ffb700 1 -- 172.21.15.112:0/2518219385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f400b830 con 0x7f3404065d30 2020-11-20T11:18:09.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3401ffb700 1 -- 172.21.15.112:0/2518219385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f4000e90 con 0x7f3404065d30 2020-11-20T11:18:09.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.378+0000 7f3401ffb700 1 -- 172.21.15.112:0/2518219385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f400bba0 con 0x7f3404065d30 2020-11-20T11:18:09.386 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 -- 172.21.15.112:0/2518219385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3404065d30 msgr2=0x7f3404066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 --2- 172.21.15.112:0/2518219385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3404065d30 0x7f3404066110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f34040651b0 tx=0x7f33f4006ef0).stop 2020-11-20T11:18:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 -- 172.21.15.112:0/2518219385 shutdown_connections 2020-11-20T11:18:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.166:3300/0 conn(0x7f34040c4c60 0x7f34041512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 --2- 172.21.15.112:0/2518219385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3404065d30 0x7f3404066110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.387 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 --2- 172.21.15.112:0/2518219385 >> v2:172.21.15.204:3300/0 conn(0x7f34040bfa50 0x7f34040c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 -- 172.21.15.112:0/2518219385 >> 172.21.15.112:0/2518219385 conn(0x7f340405bac0 msgr2=0x7f340405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 -- 172.21.15.112:0/2518219385 shutdown_connections 2020-11-20T11:18:09.388 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.379+0000 7f3409951700 1 -- 172.21.15.112:0/2518219385 wait complete. 2020-11-20T11:18:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.380+0000 7f3409951700 1 Processor -- start 2020-11-20T11:18:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.380+0000 7f3409951700 1 -- start start 2020-11-20T11:18:09.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3404065d30 0x7f34041514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 0x7f34040b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f34040c4c60 0x7f34040b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404160940 con 0x7f34040bfa50 2020-11-20T11:18:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404160be0 con 0x7f34040c4c60 2020-11-20T11:18:09.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3409951700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404160e80 con 0x7f3404065d30 2020-11-20T11:18:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f34027fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 0x7f34040b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f34027fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 0x7f34040b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50854/0 (socket says 172.21.15.112:50854) 2020-11-20T11:18:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f34027fc700 1 -- 172.21.15.112:0/3190044972 learned_addr learned my addr 172.21.15.112:0/3190044972 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f34037fe700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f34040c4c60 0x7f34040b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.381+0000 7f3402ffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3404065d30 0x7f34041514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 -- 172.21.15.112:0/3190044972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3404065d30 msgr2=0x7f34041514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3404065d30 0x7f34041514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 -- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f34040c4c60 msgr2=0x7f34040b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f34040c4c60 0x7f34040b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404161120 con 0x7f34040bfa50 2020-11-20T11:18:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f3402ffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3404065d30 0x7f34041514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f34027fc700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 0x7f34040b1760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f33f800cb20 tx=0x7f33f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8007740 con 0x7f34040bfa50 2020-11-20T11:18:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f80078a0 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34041613c0 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8007c20 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.382+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34040b0340 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.383+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3404065740 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.383+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f33f8011620 con 0x7f34040bfa50 2020-11-20T11:18:09.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f33eaffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f33e0080670 0x7f33e0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f33f80a2b00 con 0x7f34040bfa50 2020-11-20T11:18:09.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f33eaffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f33e00893a0 0x7f33e008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33e008be20 con 0x7f33e00893a0 2020-11-20T11:18:09.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33f80a7220 con 0x7f34040bfa50 2020-11-20T11:18:09.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f3402ffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f33e0080670 0x7f33e0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f34037fe700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f33e00893a0 0x7f33e008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.384+0000 7f3402ffd700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f33e0080670 0x7f33e0082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f33f4006f30 tx=0x7f33f4016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.385+0000 7f34037fe700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f33e00893a0 0x7f33e008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.385+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== osd.9 v2:172.21.15.112:6818/23143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f33e008be20 con 0x7f33e00893a0 2020-11-20T11:18:09.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 --> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3404156c60 con 0x7f33e00893a0 2020-11-20T11:18:09.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f33eaffd700 1 -- 172.21.15.112:0/3190044972 <== osd.9 v2:172.21.15.112:6818/23143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3404156c60 con 0x7f33e00893a0 2020-11-20T11:18:09.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f33e00893a0 msgr2=0x7f33e008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f33e00893a0 0x7f33e008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f33e0080670 msgr2=0x7f33e0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f33e0080670 0x7f33e0082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f33f4006f30 tx=0x7f33f4016000).stop 2020-11-20T11:18:09.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 msgr2=0x7f34040b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 --2- 172.21.15.112:0/3190044972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34040bfa50 0x7f34040b1760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f33f800cb20 tx=0x7f33f8008040).stop 2020-11-20T11:18:09.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f34037fe700 1 -- 172.21.15.112:0/3190044972 reap_dead start 2020-11-20T11:18:09.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.399+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 shutdown_connections 2020-11-20T11:18:09.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.400+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 >> 172.21.15.112:0/3190044972 conn(0x7f340405bac0 msgr2=0x7f340414f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.400+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 shutdown_connections 2020-11-20T11:18:09.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.400+0000 7f3409951700 1 -- 172.21.15.112:0/3190044972 wait complete. 2020-11-20T11:18:09.412 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:09.412 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T11:18:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.520+0000 7fc588b28700 1 Processor -- start 2020-11-20T11:18:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.520+0000 7fc588b28700 1 -- start start 2020-11-20T11:18:09.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc588b28700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584060790 con 0x7fc5840c7df0 2020-11-20T11:18:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc588b28700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584060a30 con 0x7fc5840c4f20 2020-11-20T11:18:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc588b28700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584060cd0 con 0x7fc5840c7a10 2020-11-20T11:18:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc582ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc5840c7df0 0x7fc5840c4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35056/0 (socket says 172.21.15.112:35056) 2020-11-20T11:18:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc582ffd700 1 -- 172.21.15.112:0/1588796932 learned_addr learned my addr 172.21.15.112:0/1588796932 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376286915 0 0) 0x7fc584060790 con 0x7fc5840c7df0 2020-11-20T11:18:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc570003280 con 0x7fc5840c7df0 2020-11-20T11:18:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064303162 0 0) 0x7fc584060cd0 con 0x7fc5840c7a10 2020-11-20T11:18:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc584060790 con 0x7fc5840c7a10 2020-11-20T11:18:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432749786 0 0) 0x7fc584060a30 con 0x7fc5840c4f20 2020-11-20T11:18:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc584060cd0 con 0x7fc5840c4f20 2020-11-20T11:18:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3325734047 0 0) 0x7fc570003280 con 0x7fc5840c7df0 2020-11-20T11:18:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 >> v1:172.21.15.204:6789/0 conn(0x7fc5840c7a10 legacy=0x7fc5840bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 >> v1:172.21.15.166:6789/0 conn(0x7fc5840c4f20 legacy=0x7fc58415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584060f70 con 0x7fc5840c7df0 2020-11-20T11:18:09.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fc578001520 con 0x7fc5840c7df0 2020-11-20T11:18:09.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 >> v1:172.21.15.112:6789/0 conn(0x7fc5840c7df0 legacy=0x7fc5840c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc570003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5700045c0 0x7fc570004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc570005040 0x7fc57000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000be00 con 0x7fc570003b60 2020-11-20T11:18:09.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000bf70 con 0x7fc570005040 2020-11-20T11:18:09.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.521+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000c130 con 0x7fc5700045c0 2020-11-20T11:18:09.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc570003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc582ffd700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5700045c0 0x7fc570004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc583fff700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc570005040 0x7fc57000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 -- 172.21.15.112:0/1588796932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5700045c0 msgr2=0x7fc570004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5700045c0 0x7fc570004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 -- 172.21.15.112:0/1588796932 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc570005040 msgr2=0x7fc57000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc570005040 0x7fc57000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 -- 172.21.15.112:0/1588796932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570003280 con 0x7fc570003b60 2020-11-20T11:18:09.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc583fff700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc570005040 0x7fc57000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:09.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc583fff700 1 -- 172.21.15.112:0/1588796932 reap_dead start 2020-11-20T11:18:09.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5837fe700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc570003f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc574001ad0 tx=0x7fc574007bb0).ready entity=mon.0 client_cookie=c1f702c977d8073 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400c860 con 0x7fc570003b60 2020-11-20T11:18:09.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574001e90 con 0x7fc570003b60 2020-11-20T11:18:09.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.522+0000 7fc5827fc700 1 -- 172.21.15.112:0/1588796932 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400cbf0 con 0x7fc570003b60 2020-11-20T11:18:09.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 -- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 msgr2=0x7fc570003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc570003f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc574001ad0 tx=0x7fc574007bb0).stop 2020-11-20T11:18:09.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 -- 172.21.15.112:0/1588796932 shutdown_connections 2020-11-20T11:18:09.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 --2- 172.21.15.112:0/1588796932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc570003f60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 -- 172.21.15.112:0/1588796932 >> 172.21.15.112:0/1588796932 conn(0x7fc58405bac0 msgr2=0x7fc584062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 -- 172.21.15.112:0/1588796932 shutdown_connections 2020-11-20T11:18:09.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.523+0000 7fc588b28700 1 -- 172.21.15.112:0/1588796932 wait complete. 2020-11-20T11:18:09.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.524+0000 7fc588b28700 1 Processor -- start 2020-11-20T11:18:09.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.524+0000 7fc588b28700 1 -- start start 2020-11-20T11:18:09.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc5841571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc584154600 0x7fc5840c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5840c18b0 0x7fc5841632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c6120 con 0x7fc570003b60 2020-11-20T11:18:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c63c0 con 0x7fc584154600 2020-11-20T11:18:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c6660 con 0x7fc5840c18b0 2020-11-20T11:18:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc5841571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc5841571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50872/0 (socket says 172.21.15.112:50872) 2020-11-20T11:18:09.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 -- 172.21.15.112:0/2422073347 learned_addr learned my addr 172.21.15.112:0/2422073347 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc582ffd700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc584154600 0x7fc5840c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc583fff700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5840c18b0 0x7fc5841632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 -- 172.21.15.112:0/2422073347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5840c18b0 msgr2=0x7fc5841632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc5840c18b0 0x7fc5841632f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 -- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc584154600 msgr2=0x7fc5840c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc584154600 0x7fc5840c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840c6900 con 0x7fc570003b60 2020-11-20T11:18:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5837fe700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc5841571b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc57000bf40 tx=0x7fc574016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574007240 con 0x7fc570003b60 2020-11-20T11:18:09.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740073a0 con 0x7fc570003b60 2020-11-20T11:18:09.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840c6ba0 con 0x7fc570003b60 2020-11-20T11:18:09.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574013890 con 0x7fc570003b60 2020-11-20T11:18:09.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.525+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5840b0340 con 0x7fc570003b60 2020-11-20T11:18:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.526+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5840b0590 con 0x7fc570003b60 2020-11-20T11:18:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.527+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc574023020 con 0x7fc570003b60 2020-11-20T11:18:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.527+0000 7fc5637fe700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc55c080670 0x7fc55c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.527+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc5740a3ef0 con 0x7fc570003b60 2020-11-20T11:18:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc5637fe700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7fc55c0893a0 0x7fc55c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc55c08be20 con 0x7fc55c0893a0 2020-11-20T11:18:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5740a4200 con 0x7fc570003b60 2020-11-20T11:18:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc582ffd700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc55c080670 0x7fc55c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc583fff700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7fc55c0893a0 0x7fc55c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc582ffd700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc55c080670 0x7fc55c082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc5840c6f80 tx=0x7fc584060e60).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.528+0000 7fc583fff700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7fc55c0893a0 0x7fc55c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.529+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== osd.10 v2:172.21.15.166:6818/22861 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fc55c08be20 con 0x7fc55c0893a0 2020-11-20T11:18:09.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.543+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 --> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5840008d0 con 0x7fc55c0893a0 2020-11-20T11:18:09.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc5637fe700 1 -- 172.21.15.112:0/2422073347 <== osd.10 v2:172.21.15.166:6818/22861 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5840008d0 con 0x7fc55c0893a0 2020-11-20T11:18:09.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7fc55c0893a0 msgr2=0x7fc55c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7fc55c0893a0 0x7fc55c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc55c080670 msgr2=0x7fc55c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc55c080670 0x7fc55c082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc5840c6f80 tx=0x7fc584060e60).stop 2020-11-20T11:18:09.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 msgr2=0x7fc5841571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 --2- 172.21.15.112:0/2422073347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc570003b60 0x7fc5841571b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc57000bf40 tx=0x7fc574016000).stop 2020-11-20T11:18:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc583fff700 1 -- 172.21.15.112:0/2422073347 reap_dead start 2020-11-20T11:18:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 shutdown_connections 2020-11-20T11:18:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 >> 172.21.15.112:0/2422073347 conn(0x7fc58405bac0 msgr2=0x7fc584152000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 shutdown_connections 2020-11-20T11:18:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.544+0000 7fc588b28700 1 -- 172.21.15.112:0/2422073347 wait complete. 2020-11-20T11:18:09.557 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:09.558 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T11:18:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.664+0000 7f5cdb31f700 1 Processor -- start 2020-11-20T11:18:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.665+0000 7f5cdb31f700 1 -- start start 2020-11-20T11:18:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.665+0000 7f5cdb31f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f5cd40c4f20 0x7f5cd40601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdb31f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd4060790 con 0x7f5cd40c7a10 2020-11-20T11:18:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdb31f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd4060a30 con 0x7f5cd40c7df0 2020-11-20T11:18:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdb31f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd40c4150 con 0x7f5cd40c4f20 2020-11-20T11:18:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cda31d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5cd40c7a10 0x7f5cd40bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35076/0 (socket says 172.21.15.112:35076) 2020-11-20T11:18:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cda31d700 1 -- 172.21.15.112:0/4130212356 learned_addr learned my addr 172.21.15.112:0/4130212356 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdab1e700 1 --2- 172.21.15.112:0/4130212356 >> v2:172.21.15.166:3300/0 conn(0x7f5cd40c4f20 0x7f5cd40601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294986040 0 0) 0x7f5cd4060790 con 0x7f5cd40c7a10 2020-11-20T11:18:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cbc003280 con 0x7f5cd40c7a10 2020-11-20T11:18:09.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdab1e700 1 -- 172.21.15.112:0/4130212356 >> v1:172.21.15.166:6789/0 conn(0x7f5cd40c7df0 legacy=0x7f5cd40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1492016195 0 0) 0x7f5cbc003280 con 0x7f5cd40c7a10 2020-11-20T11:18:09.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdab1e700 1 -- 172.21.15.112:0/4130212356 >> v1:172.21.15.112:6789/0 conn(0x7f5cd40c7a10 legacy=0x7f5cd40bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdab1e700 1 -- 172.21.15.112:0/4130212356 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4060cd0 con 0x7f5cd40c4f20 2020-11-20T11:18:09.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cdab1e700 1 --2- 172.21.15.112:0/4130212356 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40601b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5ccc009ce0 tx=0x7f5ccc009220).ready entity=mon.1 client_cookie=cc5b94ab6f901e2f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0001520 con 0x7f5cd40c4f20 2020-11-20T11:18:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.666+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00b730 con 0x7f5cd40c4f20 2020-11-20T11:18:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cd931b700 1 -- 172.21.15.112:0/4130212356 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00bab0 con 0x7f5cd40c4f20 2020-11-20T11:18:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 -- 172.21.15.112:0/4130212356 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c4f20 msgr2=0x7f5cd40601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 --2- 172.21.15.112:0/4130212356 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40601b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5ccc009ce0 tx=0x7f5ccc009220).stop 2020-11-20T11:18:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 -- 172.21.15.112:0/4130212356 shutdown_connections 2020-11-20T11:18:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 --2- 172.21.15.112:0/4130212356 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40601b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 -- 172.21.15.112:0/4130212356 >> 172.21.15.112:0/4130212356 conn(0x7f5cd405bac0 msgr2=0x7f5cd4062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 -- 172.21.15.112:0/4130212356 shutdown_connections 2020-11-20T11:18:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.667+0000 7f5cdb31f700 1 -- 172.21.15.112:0/4130212356 wait complete. 2020-11-20T11:18:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.668+0000 7f5cdb31f700 1 Processor -- start 2020-11-20T11:18:09.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.668+0000 7f5cdb31f700 1 -- start start 2020-11-20T11:18:09.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40bae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c7a10 0x7f5cd40b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 0x7f5cd413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40b1100 con 0x7f5cd40c7df0 2020-11-20T11:18:09.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40b0e60 con 0x7f5cd40c7a10 2020-11-20T11:18:09.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd4163b10 con 0x7f5cd40c4f20 2020-11-20T11:18:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 0x7f5cd413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 0x7f5cd413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50892/0 (socket says 172.21.15.112:50892) 2020-11-20T11:18:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 -- 172.21.15.112:0/1551495329 learned_addr learned my addr 172.21.15.112:0/1551495329 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cda31d700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40bae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cd9b1c700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c7a10 0x7f5cd40b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 -- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cd40c4f20 msgr2=0x7f5cd40bae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cd40c4f20 0x7f5cd40bae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 -- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c7a10 msgr2=0x7f5cd40b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5cd40c7a10 0x7f5cd40b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4163db0 con 0x7f5cd40c7df0 2020-11-20T11:18:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdab1e700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 0x7f5cd413fd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5cd40645d0 tx=0x7f5cd4061210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc020070 con 0x7f5cd40c7df0 2020-11-20T11:18:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc01b680 con 0x7f5cd40c7df0 2020-11-20T11:18:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd4164050 con 0x7f5cd40c7df0 2020-11-20T11:18:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc01ba00 con 0x7f5cd40c7df0 2020-11-20T11:18:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.669+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd40bc310 con 0x7f5cd40c7df0 2020-11-20T11:18:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.670+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cd40008d0 con 0x7f5cd40c7df0 2020-11-20T11:18:09.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.671+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5ccc02d070 con 0x7f5cd40c7df0 2020-11-20T11:18:09.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.671+0000 7f5cc27fc700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5cac080670 0x7f5cac082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5ccc0a4d80 con 0x7f5cd40c7df0 2020-11-20T11:18:09.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cc27fc700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f5cac0893a0 0x7f5cac08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cac08be20 con 0x7f5cac0893a0 2020-11-20T11:18:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ccc0a50f0 con 0x7f5cd40c7df0 2020-11-20T11:18:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cda31d700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5cac080670 0x7f5cac082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cd9b1c700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f5cac0893a0 0x7f5cac08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cda31d700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5cac080670 0x7f5cac082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5cd00013e0 tx=0x7f5cd0001370).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.695 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.672+0000 7f5cd9b1c700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f5cac0893a0 0x7f5cac08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.695 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.673+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== osd.11 v2:172.21.15.204:6816/23311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f5cac08be20 con 0x7f5cac0893a0 2020-11-20T11:18:09.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.687+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 --> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cd41644b0 con 0x7f5cac0893a0 2020-11-20T11:18:09.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cc27fc700 1 -- 172.21.15.112:0/1551495329 <== osd.11 v2:172.21.15.204:6816/23311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5cd41644b0 con 0x7f5cac0893a0 2020-11-20T11:18:09.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f5cac0893a0 msgr2=0x7f5cac08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f5cac0893a0 0x7f5cac08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5cac080670 msgr2=0x7f5cac082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5cac080670 0x7f5cac082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5cd00013e0 tx=0x7f5cd0001370).stop 2020-11-20T11:18:09.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 msgr2=0x7f5cd413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 --2- 172.21.15.112:0/1551495329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cd40c7df0 0x7f5cd413fd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5cd40645d0 tx=0x7f5cd4061210).stop 2020-11-20T11:18:09.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdab1e700 1 -- 172.21.15.112:0/1551495329 reap_dead start 2020-11-20T11:18:09.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 shutdown_connections 2020-11-20T11:18:09.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 >> 172.21.15.112:0/1551495329 conn(0x7f5cd405bac0 msgr2=0x7f5cd4151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 shutdown_connections 2020-11-20T11:18:09.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.688+0000 7f5cdb31f700 1 -- 172.21.15.112:0/1551495329 wait complete. 2020-11-20T11:18:09.701 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:09.701 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:18:09.812 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.810+0000 7fcd81260700 1 Processor -- start 2020-11-20T11:18:09.812 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.810+0000 7fcd81260700 1 -- start start 2020-11-20T11:18:09.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd81260700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd81260700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c060790 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd81260700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c060a30 con 0x7fcd7c0c7a10 2020-11-20T11:18:09.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd81260700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c4150 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50900/0 (socket says 172.21.15.112:50900) 2020-11-20T11:18:09.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 -- 172.21.15.112:0/3535282546 learned_addr learned my addr 172.21.15.112:0/3535282546 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 -- 172.21.15.112:0/3535282546 >> v1:172.21.15.204:6789/0 conn(0x7fcd7c0c7a10 legacy=0x7fcd7c0bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 -- 172.21.15.112:0/3535282546 >> v1:172.21.15.166:6789/0 conn(0x7fcd7c0c7df0 legacy=0x7fcd7c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:09.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 -- 172.21.15.112:0/3535282546 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c060cd0 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd80a5f700 1 --2- 172.21.15.112:0/3535282546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fcd74009d90 tx=0x7fcd740092d0).ready entity=mon.0 client_cookie=f7b471ef707a4df3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd7affd700 1 -- 172.21.15.112:0/3535282546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400bbb0 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd7affd700 1 -- 172.21.15.112:0/3535282546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400bd10 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.811+0000 7fcd7affd700 1 -- 172.21.15.112:0/3535282546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74011610 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 -- 172.21.15.112:0/3535282546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c4f20 msgr2=0x7fcd7c0601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 --2- 172.21.15.112:0/3535282546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fcd74009d90 tx=0x7fcd740092d0).stop 2020-11-20T11:18:09.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 -- 172.21.15.112:0/3535282546 shutdown_connections 2020-11-20T11:18:09.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 --2- 172.21.15.112:0/3535282546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c0601b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 -- 172.21.15.112:0/3535282546 >> 172.21.15.112:0/3535282546 conn(0x7fcd7c05bac0 msgr2=0x7fcd7c062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 -- 172.21.15.112:0/3535282546 shutdown_connections 2020-11-20T11:18:09.818 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.812+0000 7fcd81260700 1 -- 172.21.15.112:0/3535282546 wait complete. 2020-11-20T11:18:09.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.813+0000 7fcd81260700 1 Processor -- start 2020-11-20T11:18:09.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.813+0000 7fcd81260700 1 -- start start 2020-11-20T11:18:09.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 0x7fcd7c0bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c163e50 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1640f0 con 0x7fcd7c0c7a10 2020-11-20T11:18:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c164390 con 0x7fcd7c0c4f20 2020-11-20T11:18:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50908/0 (socket says 172.21.15.112:50908) 2020-11-20T11:18:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 -- 172.21.15.112:0/2429066483 learned_addr learned my addr 172.21.15.112:0/2429066483 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:09.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd7b7fe700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 0x7fcd7c0bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd7bfff700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 -- 172.21.15.112:0/2429066483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd7c0c4f20 msgr2=0x7fcd7c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 -- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 msgr2=0x7fcd7c0bc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 0x7fcd7c0bc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 -- 172.21.15.112:0/2429066483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c164630 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd7b7fe700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 0x7fcd7c0bc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:09.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd80a5f700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fcd74009310 tx=0x7fcd74016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74011e70 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400be80 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c1648d0 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74010dd0 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.814+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0c69f0 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.815+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c067970 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.827 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.816+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcd74017070 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.827 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.816+0000 7fcd5bfff700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 0x7fcd54082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:09.827 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.816+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcd740a4eb0 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.827 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.817+0000 7fcd7bfff700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 0x7fcd54082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:09.827 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.817+0000 7fcd7bfff700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 0x7fcd54082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcd70002490 tx=0x7fcd70009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:09.828 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.820+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcd740798c0 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.958+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd7c067970 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.959+0000 7fcd5bfff700 1 -- 172.21.15.112:0/2429066483 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd74015030 con 0x7fcd7c0c7df0 2020-11-20T11:18:09.961 INFO:teuthology.orchestra.run.smithi112.stdout:77309411332 2020-11-20T11:18:09.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 msgr2=0x7fcd54082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 0x7fcd54082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcd70002490 tx=0x7fcd70009040).stop 2020-11-20T11:18:09.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 msgr2=0x7fcd7c0bc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:09.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fcd74009310 tx=0x7fcd74016000).stop 2020-11-20T11:18:09.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 shutdown_connections 2020-11-20T11:18:09.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fcd54080670 0x7fcd54082b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd7c0c7df0 0x7fcd7c0bc6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd7c0c4f20 0x7fcd7c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 --2- 172.21.15.112:0/2429066483 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fcd7c0c7a10 0x7fcd7c0bc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:09.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 >> 172.21.15.112:0/2429066483 conn(0x7fcd7c05bac0 msgr2=0x7fcd7c0c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:09.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 shutdown_connections 2020-11-20T11:18:09.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:09.960+0000 7fcd81260700 1 -- 172.21.15.112:0/2429066483 wait complete. 2020-11-20T11:18:09.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411332 for osd.0 2020-11-20T11:18:10.975 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:18:11.319 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.317+0000 7f1c5e929700 1 Processor -- start 2020-11-20T11:18:11.320 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.318+0000 7f1c5e929700 1 -- start start 2020-11-20T11:18:11.323 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.318+0000 7f1c5e929700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c58066110 0x7f1c5814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.323 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.318+0000 7f1c5e929700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5814f310 con 0x7f1c580be020 2020-11-20T11:18:11.323 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.318+0000 7f1c5e929700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5814f5b0 con 0x7f1c58065d30 2020-11-20T11:18:11.324 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.318+0000 7f1c5e929700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5814cba0 con 0x7f1c58066110 2020-11-20T11:18:11.324 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c577fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1c580be020 0x7f1c580bcbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35110/0 (socket says 172.21.15.112:35110) 2020-11-20T11:18:11.324 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c577fe700 1 -- 172.21.15.112:0/1967575624 learned_addr learned my addr 172.21.15.112:0/1967575624 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:11.324 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1967575624 >> v2:172.21.15.204:3300/0 conn(0x7f1c58066110 0x7f1c5814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.324 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267423204 0 0) 0x7f1c5814f310 con 0x7f1c580be020 2020-11-20T11:18:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c44003280 con 0x7f1c580be020 2020-11-20T11:18:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 175301795 0 0) 0x7f1c44003280 con 0x7f1c580be020 2020-11-20T11:18:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 >> v2:172.21.15.204:3300/0 conn(0x7f1c58066110 msgr2=0x7f1c5814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 --2- 172.21.15.112:0/1967575624 >> v2:172.21.15.204:3300/0 conn(0x7f1c58066110 0x7f1c5814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 >> v1:172.21.15.166:6789/0 conn(0x7f1c58065d30 legacy=0x7f1c5814bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5814f850 con 0x7f1c580be020 2020-11-20T11:18:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f1c48001520 con 0x7f1c580be020 2020-11-20T11:18:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 >> v1:172.21.15.112:6789/0 conn(0x7f1c580be020 legacy=0x7f1c580bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c440037c0 0x7f1c44003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c44004520 0x7f1c440049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c4400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c440053c0 con 0x7f1c44004e90 2020-11-20T11:18:11.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4400bc60 con 0x7f1c44004520 2020-11-20T11:18:11.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4400be20 con 0x7f1c440037c0 2020-11-20T11:18:11.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c4400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c57fff700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c440037c0 0x7f1c44003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.319+0000 7f1c577fe700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c44004520 0x7f1c440049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 -- 172.21.15.112:0/1967575624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c440037c0 msgr2=0x7f1c44003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c440037c0 0x7f1c44003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 -- 172.21.15.112:0/1967575624 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c44004520 msgr2=0x7f1c440049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c44004520 0x7f1c440049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 -- 172.21.15.112:0/1967575624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44003280 con 0x7f1c44004e90 2020-11-20T11:18:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 -- 172.21.15.112:0/1967575624 reap_dead start 2020-11-20T11:18:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c4400b770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1c50009ef0 tx=0x7f1c50009220).ready entity=mon.0 client_cookie=251998f652acc276 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50009610 con 0x7f1c44004e90 2020-11-20T11:18:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000ec80 con 0x7f1c44004e90 2020-11-20T11:18:11.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c56ffd700 1 -- 172.21.15.112:0/1967575624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c500123f0 con 0x7f1c44004e90 2020-11-20T11:18:11.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 -- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 msgr2=0x7f1c4400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c4400b770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1c50009ef0 tx=0x7f1c50009220).stop 2020-11-20T11:18:11.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 -- 172.21.15.112:0/1967575624 shutdown_connections 2020-11-20T11:18:11.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1967575624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c4400b770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.332 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 -- 172.21.15.112:0/1967575624 >> 172.21.15.112:0/1967575624 conn(0x7f1c5805bac0 msgr2=0x7f1c5805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:11.332 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.320+0000 7f1c5e929700 1 -- 172.21.15.112:0/1967575624 shutdown_connections 2020-11-20T11:18:11.332 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.321+0000 7f1c5e929700 1 -- 172.21.15.112:0/1967575624 wait complete. 2020-11-20T11:18:11.332 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 Processor -- start 2020-11-20T11:18:11.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 -- start start 2020-11-20T11:18:11.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c580b9cf0 0x7f1c580b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c580b1030 0x7f1c58148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.322+0000 7f1c5e929700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580c2f10 con 0x7f1c44004e90 2020-11-20T11:18:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c5e929700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580c21f0 con 0x7f1c580b9cf0 2020-11-20T11:18:11.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c5e929700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580c2490 con 0x7f1c580b1030 2020-11-20T11:18:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50924/0 (socket says 172.21.15.112:50924) 2020-11-20T11:18:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 -- 172.21.15.112:0/1631143392 learned_addr learned my addr 172.21.15.112:0/1631143392 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c5cec6700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c580b1030 0x7f1c58148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c577fe700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c580b9cf0 0x7f1c580b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 -- 172.21.15.112:0/1631143392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c580b1030 msgr2=0x7f1c58148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c580b1030 0x7f1c58148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 -- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c580b9cf0 msgr2=0x7f1c580b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c580b9cf0 0x7f1c580b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 -- 172.21.15.112:0/1631143392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c580c2730 con 0x7f1c44004e90 2020-11-20T11:18:11.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c57fff700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f1c4c002960 tx=0x7f1c4c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00f870 con 0x7f1c44004e90 2020-11-20T11:18:11.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00f9d0 con 0x7f1c44004e90 2020-11-20T11:18:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00fd50 con 0x7f1c44004e90 2020-11-20T11:18:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c580c29d0 con 0x7f1c44004e90 2020-11-20T11:18:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.323+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c581495d0 con 0x7f1c44004e90 2020-11-20T11:18:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.324+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c58153500 con 0x7f1c44004e90 2020-11-20T11:18:11.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.325+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1c4c01b030 con 0x7f1c44004e90 2020-11-20T11:18:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.325+0000 7f1c37fff700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 0x7f1c30082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.326+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1c4c0a2610 con 0x7f1c44004e90 2020-11-20T11:18:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.326+0000 7f1c577fe700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 0x7f1c30082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.326+0000 7f1c577fe700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 0x7f1c30082b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1c580c0cc0 tx=0x7f1c48009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.329+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1c4c045fd0 con 0x7f1c44004e90 2020-11-20T11:18:11.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.468+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c580666c0 con 0x7f1c44004e90 2020-11-20T11:18:11.471 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.469+0000 7f1c37fff700 1 -- 172.21.15.112:0/1631143392 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c4c077020 con 0x7f1c44004e90 2020-11-20T11:18:11.471 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:11.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 msgr2=0x7f1c30082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 0x7f1c30082b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1c580c0cc0 tx=0x7f1c48009040).stop 2020-11-20T11:18:11.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 msgr2=0x7f1c5814e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f1c4c002960 tx=0x7f1c4c007bd0).stop 2020-11-20T11:18:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 shutdown_connections 2020-11-20T11:18:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1c300806a0 0x7f1c30082b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c580b1030 0x7f1c58148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44004e90 0x7f1c5814e8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 --2- 172.21.15.112:0/1631143392 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1c580b9cf0 0x7f1c580b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 >> 172.21.15.112:0/1631143392 conn(0x7f1c5805bac0 msgr2=0x7f1c5805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:11.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 shutdown_connections 2020-11-20T11:18:11.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.470+0000 7f1c5e929700 1 -- 172.21.15.112:0/1631143392 wait complete. 2020-11-20T11:18:11.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411333 for osd.0 2020-11-20T11:18:11.483 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T11:18:11.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.590+0000 7f73d7476700 1 Processor -- start 2020-11-20T11:18:11.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.590+0000 7f73d7476700 1 -- start start 2020-11-20T11:18:11.600 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d7476700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f73d0066f40 0x7f73d00bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d7476700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73d01518f0 0x7f73d0151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d7476700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d0151490 con 0x7f73d0066b60 2020-11-20T11:18:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d7476700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d0064510 con 0x7f73d01518f0 2020-11-20T11:18:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d7476700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d00bbdd0 con 0x7f73d0066f40 2020-11-20T11:18:11.602 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.591+0000 7f73d5a13700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73d01518f0 0x7f73d0151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.602 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73d01518f0 0x7f73d0151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50934/0 (socket says 172.21.15.112:50934) 2020-11-20T11:18:11.602 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 -- 172.21.15.112:0/2265584423 learned_addr learned my addr 172.21.15.112:0/2265584423 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:11.603 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d4a11700 1 --2- 172.21.15.112:0/2265584423 >> v2:172.21.15.166:3300/0 conn(0x7f73d0066f40 0x7f73d00bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.603 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 -- 172.21.15.112:0/2265584423 >> v2:172.21.15.166:3300/0 conn(0x7f73d0066f40 msgr2=0x7f73d00bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.603 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 --2- 172.21.15.112:0/2265584423 >> v2:172.21.15.166:3300/0 conn(0x7f73d0066f40 0x7f73d00bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 -- 172.21.15.112:0/2265584423 >> v1:172.21.15.166:6789/0 conn(0x7f73d0066b60 legacy=0x7f73d00c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 -- 172.21.15.112:0/2265584423 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0063a90 con 0x7f73d01518f0 2020-11-20T11:18:11.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d5a13700 1 --2- 172.21.15.112:0/2265584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0151d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f73d00646b0 tx=0x7f73c80092d0).ready entity=mon.0 client_cookie=e808b9ce899e2156 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73bffff700 1 -- 172.21.15.112:0/2265584423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800bbc0 con 0x7f73d01518f0 2020-11-20T11:18:11.605 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73bffff700 1 -- 172.21.15.112:0/2265584423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c800bd20 con 0x7f73d01518f0 2020-11-20T11:18:11.605 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73bffff700 1 -- 172.21.15.112:0/2265584423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011610 con 0x7f73d01518f0 2020-11-20T11:18:11.605 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 -- 172.21.15.112:0/2265584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 msgr2=0x7f73d0151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.606 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 --2- 172.21.15.112:0/2265584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0151d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f73d00646b0 tx=0x7f73c80092d0).stop 2020-11-20T11:18:11.606 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 -- 172.21.15.112:0/2265584423 shutdown_connections 2020-11-20T11:18:11.606 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 --2- 172.21.15.112:0/2265584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0151d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.606 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 --2- 172.21.15.112:0/2265584423 >> v2:172.21.15.166:3300/0 conn(0x7f73d0066f40 0x7f73d00bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.607 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.592+0000 7f73d7476700 1 -- 172.21.15.112:0/2265584423 >> 172.21.15.112:0/2265584423 conn(0x7f73d00bac60 msgr2=0x7f73d00bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:11.607 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.593+0000 7f73d7476700 1 -- 172.21.15.112:0/2265584423 shutdown_connections 2020-11-20T11:18:11.607 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.593+0000 7f73d7476700 1 -- 172.21.15.112:0/2265584423 wait complete. 2020-11-20T11:18:11.608 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.594+0000 7f73d7476700 1 Processor -- start 2020-11-20T11:18:11.608 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.594+0000 7f73d7476700 1 -- start start 2020-11-20T11:18:11.608 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f73d0066b60 0x7f73d0164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.608 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d0066f40 0x7f73d0161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.609 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.609 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0156600 con 0x7f73d01518f0 2020-11-20T11:18:11.609 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01560c0 con 0x7f73d0066b60 2020-11-20T11:18:11.609 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0156360 con 0x7f73d0066f40 2020-11-20T11:18:11.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50940/0 (socket says 172.21.15.112:50940) 2020-11-20T11:18:11.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 -- 172.21.15.112:0/788838426 learned_addr learned my addr 172.21.15.112:0/788838426 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:11.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5212700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f73d0066b60 0x7f73d0164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d4a11700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d0066f40 0x7f73d0161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 -- 172.21.15.112:0/788838426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d0066f40 msgr2=0x7f73d0161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d0066f40 0x7f73d0161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 -- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f73d0066b60 msgr2=0x7f73d0164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f73d0066b60 0x7f73d0164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 -- 172.21.15.112:0/788838426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0160920 con 0x7f73d01518f0 2020-11-20T11:18:11.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d5a13700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f73c8007fd0 tx=0x7f73c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c801c680 con 0x7f73d01518f0 2020-11-20T11:18:11.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c801c7e0 con 0x7f73d01518f0 2020-11-20T11:18:11.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d0160bc0 con 0x7f73d01518f0 2020-11-20T11:18:11.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c801cb60 con 0x7f73d01518f0 2020-11-20T11:18:11.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.595+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d0155ce0 con 0x7f73d01518f0 2020-11-20T11:18:11.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.596+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d0161020 con 0x7f73d01518f0 2020-11-20T11:18:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.597+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f73c8017070 con 0x7f73d01518f0 2020-11-20T11:18:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.598+0000 7f73bd7fa700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 0x7f73a8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.598+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f73c80a55c0 con 0x7f73d01518f0 2020-11-20T11:18:11.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.598+0000 7f73d5212700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 0x7f73a8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.598+0000 7f73d5212700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 0x7f73a8082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f73cc000c00 tx=0x7f73cc007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.600+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f73c8079fd0 con 0x7f73d01518f0 2020-11-20T11:18:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.740+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73d005d370 con 0x7f73d01518f0 2020-11-20T11:18:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.740+0000 7f73bd7fa700 1 -- 172.21.15.112:0/788838426 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73c8015090 con 0x7f73d01518f0 2020-11-20T11:18:11.743 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 msgr2=0x7f73a8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 0x7f73a8082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f73cc000c00 tx=0x7f73cc007bb0).stop 2020-11-20T11:18:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 msgr2=0x7f73d0156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.744 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f73c8007fd0 tx=0x7f73c8016000).stop 2020-11-20T11:18:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 shutdown_connections 2020-11-20T11:18:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f73a8080670 0x7f73a8082b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73d01518f0 0x7f73d0156a50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f73d0066b60 0x7f73d0164860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.745 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 --2- 172.21.15.112:0/788838426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73d0066f40 0x7f73d0161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.741+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 >> 172.21.15.112:0/788838426 conn(0x7f73d00bac60 msgr2=0x7f73d0067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:11.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.742+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 shutdown_connections 2020-11-20T11:18:11.746 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.742+0000 7f73d7476700 1 -- 172.21.15.112:0/788838426 wait complete. 2020-11-20T11:18:11.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411333 for osd.1 2020-11-20T11:18:11.755 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T11:18:11.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.862+0000 7f96c1e1e700 1 Processor -- start 2020-11-20T11:18:11.865 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.862+0000 7f96c1e1e700 1 -- start start 2020-11-20T11:18:11.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96c1e1e700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 0x7f96bc066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96c1e1e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96bc1512e0 0x7f96bc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96c1e1e700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0c5230 con 0x7f96bc0bfa50 2020-11-20T11:18:11.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96c1e1e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc1549c0 con 0x7f96bc1512e0 2020-11-20T11:18:11.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96c1e1e700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc154c60 con 0x7f96bc065d30 2020-11-20T11:18:11.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96bbfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96bc1512e0 0x7f96bc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96bbfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96bc1512e0 0x7f96bc151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50946/0 (socket says 172.21.15.112:50946) 2020-11-20T11:18:11.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.863+0000 7f96bbfff700 1 -- 172.21.15.112:0/2887992582 learned_addr learned my addr 172.21.15.112:0/2887992582 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:11.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bb7fe700 1 --2- 172.21.15.112:0/2887992582 >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 0x7f96bc066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bbfff700 1 -- 172.21.15.112:0/2887992582 >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 msgr2=0x7f96bc066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bbfff700 1 --2- 172.21.15.112:0/2887992582 >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 0x7f96bc066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bbfff700 1 -- 172.21.15.112:0/2887992582 >> v1:172.21.15.204:6789/0 conn(0x7f96bc0bfa50 legacy=0x7f96bc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bbfff700 1 -- 172.21.15.112:0/2887992582 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc154f00 con 0x7f96bc1512e0 2020-11-20T11:18:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bb7fe700 1 --2- 172.21.15.112:0/2887992582 >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 0x7f96bc066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96bbfff700 1 --2- 172.21.15.112:0/2887992582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc151710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f96bc0c79a0 tx=0x7f96b40092d0).ready entity=mon.0 client_cookie=7a4e5be4f3ae84e5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96ba7fc700 1 -- 172.21.15.112:0/2887992582 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400bbb0 con 0x7f96bc1512e0 2020-11-20T11:18:11.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96ba7fc700 1 -- 172.21.15.112:0/2887992582 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400bd10 con 0x7f96bc1512e0 2020-11-20T11:18:11.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96ba7fc700 1 -- 172.21.15.112:0/2887992582 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011610 con 0x7f96bc1512e0 2020-11-20T11:18:11.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 -- 172.21.15.112:0/2887992582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 msgr2=0x7f96bc151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/2887992582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc151710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f96bc0c79a0 tx=0x7f96b40092d0).stop 2020-11-20T11:18:11.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 -- 172.21.15.112:0/2887992582 shutdown_connections 2020-11-20T11:18:11.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/2887992582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc151710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/2887992582 >> v2:172.21.15.204:3300/0 conn(0x7f96bc065d30 0x7f96bc066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 -- 172.21.15.112:0/2887992582 >> 172.21.15.112:0/2887992582 conn(0x7f96bc05bac0 msgr2=0x7f96bc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:11.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 -- 172.21.15.112:0/2887992582 shutdown_connections 2020-11-20T11:18:11.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.864+0000 7f96c1e1e700 1 -- 172.21.15.112:0/2887992582 wait complete. 2020-11-20T11:18:11.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 Processor -- start 2020-11-20T11:18:11.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 -- start start 2020-11-20T11:18:11.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96bc065d30 0x7f96bc0609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f96bc0bfa50 0x7f96bc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0b0f10 con 0x7f96bc1512e0 2020-11-20T11:18:11.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc163a60 con 0x7f96bc0bfa50 2020-11-20T11:18:11.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96c1e1e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc14e9e0 con 0x7f96bc065d30 2020-11-20T11:18:11.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50952/0 (socket says 172.21.15.112:50952) 2020-11-20T11:18:11.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.866+0000 7f96bbfff700 1 -- 172.21.15.112:0/803445239 learned_addr learned my addr 172.21.15.112:0/803445239 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:11.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bb7fe700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96bc065d30 0x7f96bc0609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 -- 172.21.15.112:0/803445239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96bc065d30 msgr2=0x7f96bc0609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96bc065d30 0x7f96bc0609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96baffd700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f96bc0bfa50 0x7f96bc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 -- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f96bc0bfa50 msgr2=0x7f96bc0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:11.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f96bc0bfa50 0x7f96bc0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:11.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 -- 172.21.15.112:0/803445239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc14ec80 con 0x7f96bc1512e0 2020-11-20T11:18:11.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96bbfff700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f96b4006dd0 tx=0x7f96b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011e30 con 0x7f96bc1512e0 2020-11-20T11:18:11.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4010b10 con 0x7f96bc1512e0 2020-11-20T11:18:11.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc14ef20 con 0x7f96bc1512e0 2020-11-20T11:18:11.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4010e90 con 0x7f96bc1512e0 2020-11-20T11:18:11.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.867+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc14f460 con 0x7f96bc1512e0 2020-11-20T11:18:11.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.868+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc065740 con 0x7f96bc1512e0 2020-11-20T11:18:11.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.869+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f96b4017070 con 0x7f96bc1512e0 2020-11-20T11:18:11.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.869+0000 7f969b7fe700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 0x7f9694082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:11.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.869+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f96b40a5870 con 0x7f96bc1512e0 2020-11-20T11:18:11.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.870+0000 7f96bb7fe700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 0x7f9694082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:11.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.870+0000 7f96bb7fe700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 0x7f9694082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f96ac00c900 tx=0x7f96ac008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:11.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:11.872+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f96b407a200 con 0x7f96bc1512e0 2020-11-20T11:18:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.011+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96bc0666c0 con 0x7f96bc1512e0 2020-11-20T11:18:12.013 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.011+0000 7f969b7fe700 1 -- 172.21.15.112:0/803445239 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96b4015020 con 0x7f96bc1512e0 2020-11-20T11:18:12.013 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:12.014 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 msgr2=0x7f9694082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 0x7f9694082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f96ac00c900 tx=0x7f96ac008040).stop 2020-11-20T11:18:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 msgr2=0x7f96bc0b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f96b4006dd0 tx=0x7f96b4016000).stop 2020-11-20T11:18:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 shutdown_connections 2020-11-20T11:18:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9694080670 0x7f9694082b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96bc1512e0 0x7f96bc0b27b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96bc065d30 0x7f96bc0609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 --2- 172.21.15.112:0/803445239 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f96bc0bfa50 0x7f96bc0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 >> 172.21.15.112:0/803445239 conn(0x7f96bc05bac0 msgr2=0x7f96bc151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 shutdown_connections 2020-11-20T11:18:12.017 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.012+0000 7f96c1e1e700 1 -- 172.21.15.112:0/803445239 wait complete. 2020-11-20T11:18:12.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411333 for osd.2 2020-11-20T11:18:12.026 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T11:18:12.134 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.132+0000 7f65fb5ea700 1 Processor -- start 2020-11-20T11:18:12.135 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.132+0000 7f65fb5ea700 1 -- start start 2020-11-20T11:18:12.136 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65fb5ea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65f4066110 0x7f65f40bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.137 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65fb5ea700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40c5230 con 0x7f65f41512e0 2020-11-20T11:18:12.137 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65fb5ea700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f41549c0 con 0x7f65f4065d30 2020-11-20T11:18:12.137 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65fb5ea700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40bff40 con 0x7f65f4066110 2020-11-20T11:18:12.137 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65f8b85700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65f4066110 0x7f65f40bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.137 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65f8b85700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65f4066110 0x7f65f40bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50958/0 (socket says 172.21.15.112:50958) 2020-11-20T11:18:12.138 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.133+0000 7f65f8b85700 1 -- 172.21.15.112:0/2566832686 learned_addr learned my addr 172.21.15.112:0/2566832686 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.138 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65f8b85700 1 -- 172.21.15.112:0/2566832686 >> v1:172.21.15.204:6789/0 conn(0x7f65f4065d30 legacy=0x7f65f40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:12.138 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65f8b85700 1 -- 172.21.15.112:0/2566832686 >> v1:172.21.15.166:6789/0 conn(0x7f65f41512e0 legacy=0x7f65f4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:12.138 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65f8b85700 1 -- 172.21.15.112:0/2566832686 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4154c60 con 0x7f65f4066110 2020-11-20T11:18:12.138 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65f8b85700 1 --2- 172.21.15.112:0/2566832686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f4066110 0x7f65f40bfa50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f65e4009a10 tx=0x7f65e4006ef0).ready entity=mon.0 client_cookie=83ed4aed8ff18405 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65e3fff700 1 -- 172.21.15.112:0/2566832686 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400b820 con 0x7f65f4066110 2020-11-20T11:18:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65e3fff700 1 -- 172.21.15.112:0/2566832686 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4000e90 con 0x7f65f4066110 2020-11-20T11:18:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65e3fff700 1 -- 172.21.15.112:0/2566832686 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400bb90 con 0x7f65f4066110 2020-11-20T11:18:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2566832686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f4066110 msgr2=0x7f65f40bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.134+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2566832686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f4066110 0x7f65f40bfa50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f65e4009a10 tx=0x7f65e4006ef0).stop 2020-11-20T11:18:12.140 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.135+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2566832686 shutdown_connections 2020-11-20T11:18:12.140 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.135+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2566832686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f4066110 0x7f65f40bfa50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.140 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.135+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2566832686 >> 172.21.15.112:0/2566832686 conn(0x7f65f405bac0 msgr2=0x7f65f405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.140 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.135+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2566832686 shutdown_connections 2020-11-20T11:18:12.140 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.135+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2566832686 wait complete. 2020-11-20T11:18:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.136+0000 7f65fb5ea700 1 Processor -- start 2020-11-20T11:18:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.136+0000 7f65fb5ea700 1 -- start start 2020-11-20T11:18:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f65f4065d30 0x7f65f41648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f4066110 0x7f65f40b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40b21a0 con 0x7f65f41512e0 2020-11-20T11:18:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4160af0 con 0x7f65f4065d30 2020-11-20T11:18:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4160d90 con 0x7f65f4066110 2020-11-20T11:18:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50968/0 (socket says 172.21.15.112:50968) 2020-11-20T11:18:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 -- 172.21.15.112:0/2489016017 learned_addr learned my addr 172.21.15.112:0/2489016017 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9386700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f65f4065d30 0x7f65f41648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f8b85700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f4066110 0x7f65f40b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 -- 172.21.15.112:0/2489016017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f4066110 msgr2=0x7f65f40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f4066110 0x7f65f40b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 -- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f65f4065d30 msgr2=0x7f65f41648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f65f4065d30 0x7f65f41648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 -- 172.21.15.112:0/2489016017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4161030 con 0x7f65f41512e0 2020-11-20T11:18:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65f9b87700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f65ec00ca90 tx=0x7f65ec0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00a550 con 0x7f65f41512e0 2020-11-20T11:18:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00a6b0 con 0x7f65f41512e0 2020-11-20T11:18:12.148 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f41612d0 con 0x7f65f41512e0 2020-11-20T11:18:12.148 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00aa30 con 0x7f65f41512e0 2020-11-20T11:18:12.148 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.137+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4161770 con 0x7f65f41512e0 2020-11-20T11:18:12.148 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.138+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f4161460 con 0x7f65f41512e0 2020-11-20T11:18:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.139+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f65ec018020 con 0x7f65f41512e0 2020-11-20T11:18:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.139+0000 7f65e17fa700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 0x7f65cc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.139+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f65ec0a2700 con 0x7f65f41512e0 2020-11-20T11:18:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.140+0000 7f65f9386700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 0x7f65cc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.140+0000 7f65f9386700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 0x7f65cc082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f65f0006fd0 tx=0x7f65f0008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.143+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f65ec077090 con 0x7f65f41512e0 2020-11-20T11:18:12.285 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.283+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65f4065740 con 0x7f65f41512e0 2020-11-20T11:18:12.285 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.283+0000 7f65e17fa700 1 -- 172.21.15.112:0/2489016017 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65ec016070 con 0x7f65f41512e0 2020-11-20T11:18:12.285 INFO:teuthology.orchestra.run.smithi112.stdout:77309411333 2020-11-20T11:18:12.287 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 msgr2=0x7f65cc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.287 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 0x7f65cc082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f65f0006fd0 tx=0x7f65f0008040).stop 2020-11-20T11:18:12.287 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 msgr2=0x7f65f40c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.287 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f65ec00ca90 tx=0x7f65ec0013a0).stop 2020-11-20T11:18:12.288 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 shutdown_connections 2020-11-20T11:18:12.288 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f65cc080670 0x7f65cc082b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.288 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65f41512e0 0x7f65f40c0bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.288 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f65f4065d30 0x7f65f41648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.289 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 --2- 172.21.15.112:0/2489016017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f65f4066110 0x7f65f40b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.289 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.284+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 >> 172.21.15.112:0/2489016017 conn(0x7f65f405bac0 msgr2=0x7f65f414f210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.289 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.285+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 shutdown_connections 2020-11-20T11:18:12.289 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.285+0000 7f65fb5ea700 1 -- 172.21.15.112:0/2489016017 wait complete. 2020-11-20T11:18:12.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411333 for osd.3 2020-11-20T11:18:12.298 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T11:18:12.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.405+0000 7fd05a8c9700 1 Processor -- start 2020-11-20T11:18:12.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.405+0000 7fd05a8c9700 1 -- start start 2020-11-20T11:18:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd05a8c9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0541519f0 0x7fd0540bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd05a8c9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c5230 con 0x7fd054065d30 2020-11-20T11:18:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd05a8c9700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0541549c0 con 0x7fd054066110 2020-11-20T11:18:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd05a8c9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540bff40 con 0x7fd0541519f0 2020-11-20T11:18:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0541519f0 0x7fd0540bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0541519f0 0x7fd0540bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50972/0 (socket says 172.21.15.112:50972) 2020-11-20T11:18:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd053fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd054065d30 0x7fd0540c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35166/0 (socket says 172.21.15.112:35166) 2020-11-20T11:18:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 -- 172.21.15.112:0/3981306540 learned_addr learned my addr 172.21.15.112:0/3981306540 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 -- 172.21.15.112:0/3981306540 >> v1:172.21.15.166:6789/0 conn(0x7fd054066110 legacy=0x7fd0541512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 -- 172.21.15.112:0/3981306540 >> v1:172.21.15.112:6789/0 conn(0x7fd054065d30 legacy=0x7fd0540c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd058e66700 1 -- 172.21.15.112:0/3981306540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054154c60 con 0x7fd0541519f0 2020-11-20T11:18:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.406+0000 7fd052ffd700 1 -- 172.21.15.112:0/3981306540 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039333159 0 0) 0x7fd0540c5230 con 0x7fd054065d30 2020-11-20T11:18:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd058e66700 1 --2- 172.21.15.112:0/3981306540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541519f0 0x7fd0540bfa50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd04c009d90 tx=0x7fd04c0092d0).ready entity=mon.0 client_cookie=86d63ffa1cadc21e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd052ffd700 1 -- 172.21.15.112:0/3981306540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00bbf0 con 0x7fd0541519f0 2020-11-20T11:18:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd052ffd700 1 -- 172.21.15.112:0/3981306540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00bd50 con 0x7fd0541519f0 2020-11-20T11:18:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd052ffd700 1 -- 172.21.15.112:0/3981306540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c011610 con 0x7fd0541519f0 2020-11-20T11:18:12.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 -- 172.21.15.112:0/3981306540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541519f0 msgr2=0x7fd0540bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/3981306540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541519f0 0x7fd0540bfa50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd04c009d90 tx=0x7fd04c0092d0).stop 2020-11-20T11:18:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 -- 172.21.15.112:0/3981306540 shutdown_connections 2020-11-20T11:18:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/3981306540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541519f0 0x7fd0540bfa50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 -- 172.21.15.112:0/3981306540 >> 172.21.15.112:0/3981306540 conn(0x7fd05405bac0 msgr2=0x7fd05405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 -- 172.21.15.112:0/3981306540 shutdown_connections 2020-11-20T11:18:12.421 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.407+0000 7fd05a8c9700 1 -- 172.21.15.112:0/3981306540 wait complete. 2020-11-20T11:18:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.408+0000 7fd05a8c9700 1 Processor -- start 2020-11-20T11:18:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.408+0000 7fd05a8c9700 1 -- start start 2020-11-20T11:18:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.423 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd054066110 0x7fd054164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0541519f0 0x7fd0540b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054165180 con 0x7fd054065d30 2020-11-20T11:18:12.424 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05414eb10 con 0x7fd054066110 2020-11-20T11:18:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd05a8c9700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540b2750 con 0x7fd0541519f0 2020-11-20T11:18:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd053fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd053fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50978/0 (socket says 172.21.15.112:50978) 2020-11-20T11:18:12.425 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd053fff700 1 -- 172.21.15.112:0/1884269447 learned_addr learned my addr 172.21.15.112:0/1884269447 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.409+0000 7fd0537fe700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd054066110 0x7fd054164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 -- 172.21.15.112:0/1884269447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0541519f0 msgr2=0x7fd0540b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.426 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0541519f0 0x7fd0540b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:12.427 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 -- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd054066110 msgr2=0x7fd054164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.427 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd054066110 0x7fd054164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.428 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 -- 172.21.15.112:0/1884269447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540b29f0 con 0x7fd054065d30 2020-11-20T11:18:12.429 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd053fff700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd04400c710 tx=0x7fd044007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.429 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440072e0 con 0x7fd054065d30 2020-11-20T11:18:12.429 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044007440 con 0x7fd054065d30 2020-11-20T11:18:12.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0540b2c90 con 0x7fd054065d30 2020-11-20T11:18:12.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440057a0 con 0x7fd054065d30 2020-11-20T11:18:12.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.410+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0540b0760 con 0x7fd054065d30 2020-11-20T11:18:12.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.411+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0540c02e0 con 0x7fd054065d30 2020-11-20T11:18:12.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.411+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd044010070 con 0x7fd054065d30 2020-11-20T11:18:12.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.412+0000 7fd033fff700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 0x7fd02c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.412+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd0440a21d0 con 0x7fd054065d30 2020-11-20T11:18:12.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.412+0000 7fd0537fe700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 0x7fd02c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.412+0000 7fd0537fe700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 0x7fd02c082b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd048007fd0 tx=0x7fd048007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.435 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.415+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd044076be0 con 0x7fd054065d30 2020-11-20T11:18:12.558 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.556+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd054154e40 con 0x7fd054065d30 2020-11-20T11:18:12.558 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.556+0000 7fd033fff700 1 -- 172.21.15.112:0/1884269447 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0440a1020 con 0x7fd054065d30 2020-11-20T11:18:12.559 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:12.560 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 msgr2=0x7fd02c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.560 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 0x7fd02c082b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd048007fd0 tx=0x7fd048007bd0).stop 2020-11-20T11:18:12.561 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 msgr2=0x7fd0541578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.561 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd04400c710 tx=0x7fd044007cc0).stop 2020-11-20T11:18:12.561 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 shutdown_connections 2020-11-20T11:18:12.561 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd02c080670 0x7fd02c082b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.561 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0541519f0 0x7fd0540b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:12.562 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd054065d30 0x7fd0541578c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.562 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 --2- 172.21.15.112:0/1884269447 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd054066110 0x7fd054164c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.562 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 >> 172.21.15.112:0/1884269447 conn(0x7fd05405bac0 msgr2=0x7fd0540bf720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.562 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 shutdown_connections 2020-11-20T11:18:12.562 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.558+0000 7fd05a8c9700 1 -- 172.21.15.112:0/1884269447 wait complete. 2020-11-20T11:18:12.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411334 for osd.4 2020-11-20T11:18:12.572 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T11:18:12.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.680+0000 7ff515931700 1 Processor -- start 2020-11-20T11:18:12.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.680+0000 7ff515931700 1 -- start start 2020-11-20T11:18:12.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff515931700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff510065d30 0x7ff510066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff515931700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5100bfa50 0x7ff5100c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff515931700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100c5230 con 0x7ff5100c4c60 2020-11-20T11:18:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff515931700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5101549c0 con 0x7ff510065d30 2020-11-20T11:18:12.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff515931700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff510154c60 con 0x7ff5100bfa50 2020-11-20T11:18:12.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff50f7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff5100c4c60 0x7ff5101512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35180/0 (socket says 172.21.15.112:35180) 2020-11-20T11:18:12.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff50f7fe700 1 -- 172.21.15.112:0/2085200608 learned_addr learned my addr 172.21.15.112:0/2085200608 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff50effd700 1 --2- 172.21.15.112:0/2085200608 >> v2:172.21.15.166:3300/0 conn(0x7ff510065d30 0x7ff510066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff507fff700 1 --2- 172.21.15.112:0/2085200608 >> v2:172.21.15.204:3300/0 conn(0x7ff5100bfa50 0x7ff5100c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff50e7fc700 1 -- 172.21.15.112:0/2085200608 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694946183 0 0) 0x7ff5100c5230 con 0x7ff5100c4c60 2020-11-20T11:18:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.681+0000 7ff50e7fc700 1 -- 172.21.15.112:0/2085200608 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0003280 con 0x7ff5100c4c60 2020-11-20T11:18:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50effd700 1 -- 172.21.15.112:0/2085200608 >> v2:172.21.15.204:3300/0 conn(0x7ff5100bfa50 msgr2=0x7ff5100c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50effd700 1 --2- 172.21.15.112:0/2085200608 >> v2:172.21.15.204:3300/0 conn(0x7ff5100bfa50 0x7ff5100c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50effd700 1 -- 172.21.15.112:0/2085200608 >> v1:172.21.15.112:6789/0 conn(0x7ff5100c4c60 legacy=0x7ff5101512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50effd700 1 -- 172.21.15.112:0/2085200608 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510154f00 con 0x7ff510065d30 2020-11-20T11:18:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50effd700 1 --2- 172.21.15.112:0/2085200608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff510065d30 0x7ff510066110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff510066600 tx=0x7ff500006e30).ready entity=mon.1 client_cookie=8a1b75b2792cb64e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50e7fc700 1 -- 172.21.15.112:0/2085200608 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000095c0 con 0x7ff510065d30 2020-11-20T11:18:12.694 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50e7fc700 1 -- 172.21.15.112:0/2085200608 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500000e90 con 0x7ff510065d30 2020-11-20T11:18:12.694 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff50e7fc700 1 -- 172.21.15.112:0/2085200608 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500009930 con 0x7ff510065d30 2020-11-20T11:18:12.694 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 -- 172.21.15.112:0/2085200608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff510065d30 msgr2=0x7ff510066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 --2- 172.21.15.112:0/2085200608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff510065d30 0x7ff510066110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff510066600 tx=0x7ff500006e30).stop 2020-11-20T11:18:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 -- 172.21.15.112:0/2085200608 shutdown_connections 2020-11-20T11:18:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 --2- 172.21.15.112:0/2085200608 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff510065d30 0x7ff510066110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 --2- 172.21.15.112:0/2085200608 >> v2:172.21.15.204:3300/0 conn(0x7ff5100bfa50 0x7ff5100c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.682+0000 7ff515931700 1 -- 172.21.15.112:0/2085200608 >> 172.21.15.112:0/2085200608 conn(0x7ff51005bac0 msgr2=0x7ff51005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.683+0000 7ff515931700 1 -- 172.21.15.112:0/2085200608 shutdown_connections 2020-11-20T11:18:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.683+0000 7ff515931700 1 -- 172.21.15.112:0/2085200608 wait complete. 2020-11-20T11:18:12.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 Processor -- start 2020-11-20T11:18:12.697 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 -- start start 2020-11-20T11:18:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff510065d30 0x7ff51014b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5100c4c60 0x7ff510156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510160ac0 con 0x7ff5100bfa50 2020-11-20T11:18:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510160d60 con 0x7ff5100c4c60 2020-11-20T11:18:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff515931700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510161000 con 0x7ff510065d30 2020-11-20T11:18:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff507fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff507fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50992/0 (socket says 172.21.15.112:50992) 2020-11-20T11:18:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.684+0000 7ff507fff700 1 -- 172.21.15.112:0/4256963741 learned_addr learned my addr 172.21.15.112:0/4256963741 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff50effd700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff510065d30 0x7ff51014b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff50f7fe700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5100c4c60 0x7ff510156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 -- 172.21.15.112:0/4256963741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff510065d30 msgr2=0x7ff51014b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff510065d30 0x7ff51014b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 -- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5100c4c60 msgr2=0x7ff510156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5100c4c60 0x7ff510156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 -- 172.21.15.112:0/4256963741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5101612a0 con 0x7ff5100bfa50 2020-11-20T11:18:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff507fff700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff4f800eba0 tx=0x7ff4f8006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800eeb0 con 0x7ff5100bfa50 2020-11-20T11:18:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800c850 con 0x7ff5100bfa50 2020-11-20T11:18:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800cbd0 con 0x7ff5100bfa50 2020-11-20T11:18:12.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff510161540 con 0x7ff5100bfa50 2020-11-20T11:18:12.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.685+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5100c8200 con 0x7ff5100bfa50 2020-11-20T11:18:12.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.686+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100c4a80 con 0x7ff5100bfa50 2020-11-20T11:18:12.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.687+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff4f801c460 con 0x7ff5100bfa50 2020-11-20T11:18:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.687+0000 7ff506ffd700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 0x7ff4ec082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.687+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff4f80a2c40 con 0x7ff5100bfa50 2020-11-20T11:18:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.687+0000 7ff50effd700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 0x7ff4ec082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.688+0000 7ff50effd700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 0x7ff4ec082b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff500006e70 tx=0x7ff500015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.691+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff4f80775f0 con 0x7ff5100bfa50 2020-11-20T11:18:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.831+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff510156970 con 0x7ff5100bfa50 2020-11-20T11:18:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.831+0000 7ff506ffd700 1 -- 172.21.15.112:0/4256963741 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4f807ac10 con 0x7ff5100bfa50 2020-11-20T11:18:12.833 INFO:teuthology.orchestra.run.smithi112.stdout:77309411335 2020-11-20T11:18:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 msgr2=0x7ff4ec082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 0x7ff4ec082b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff500006e70 tx=0x7ff500015000).stop 2020-11-20T11:18:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 msgr2=0x7ff510155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff4f800eba0 tx=0x7ff4f8006e30).stop 2020-11-20T11:18:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 shutdown_connections 2020-11-20T11:18:12.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff4ec0806a0 0x7ff4ec082b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5100c4c60 0x7ff510156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff510065d30 0x7ff51014b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 --2- 172.21.15.112:0/4256963741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5100bfa50 0x7ff510155c20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 >> 172.21.15.112:0/4256963741 conn(0x7ff51005bac0 msgr2=0x7ff5100c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 shutdown_connections 2020-11-20T11:18:12.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.833+0000 7ff515931700 1 -- 172.21.15.112:0/4256963741 wait complete. 2020-11-20T11:18:12.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411335 for osd.5 2020-11-20T11:18:12.846 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T11:18:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.953+0000 7fb8d0c40700 1 Processor -- start 2020-11-20T11:18:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.953+0000 7fb8d0c40700 1 -- start start 2020-11-20T11:18:12.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8d0c40700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8cc065d30 0x7fb8cc066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8d0c40700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0c5230 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.958 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8d0c40700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc1549c0 con 0x7fb8cc1512e0 2020-11-20T11:18:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8d0c40700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc154c60 con 0x7fb8cc065d30 2020-11-20T11:18:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8ca59c700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8cc065d30 0x7fb8cc066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8cad9d700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fb8cc1512e0 0x7fb8cc151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:45320/0 (socket says 172.21.15.112:45320) 2020-11-20T11:18:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8cad9d700 1 -- 172.21.15.112:0/2963870233 learned_addr learned my addr 172.21.15.112:0/2963870233 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.954+0000 7fb8ca59c700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8cc065d30 0x7fb8cc066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:36776/0 (socket says 172.21.15.112:36776) 2020-11-20T11:18:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8ca59c700 1 -- 172.21.15.112:0/2963870233 >> v1:172.21.15.204:6789/0 conn(0x7fb8cc1512e0 legacy=0x7fb8cc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8ca59c700 1 -- 172.21.15.112:0/2963870233 >> v1:172.21.15.166:6789/0 conn(0x7fb8cc0bfa50 legacy=0x7fb8cc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8c959a700 1 -- 172.21.15.112:0/2963870233 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40207234 0 0) 0x7fb8cc1549c0 con 0x7fb8cc1512e0 2020-11-20T11:18:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8ca59c700 1 -- 172.21.15.112:0/2963870233 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc154f00 con 0x7fb8cc065d30 2020-11-20T11:18:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8ca59c700 1 --2- 172.21.15.112:0/2963870233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc066110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fb8bc006fd0 tx=0x7fb8bc006e30).ready entity=mon.2 client_cookie=54bd4a7adbd5d613 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8c959a700 1 -- 172.21.15.112:0/2963870233 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0097e0 con 0x7fb8cc065d30 2020-11-20T11:18:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8c959a700 1 -- 172.21.15.112:0/2963870233 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc000e90 con 0x7fb8cc065d30 2020-11-20T11:18:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8c959a700 1 -- 172.21.15.112:0/2963870233 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc009b50 con 0x7fb8cc065d30 2020-11-20T11:18:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 -- 172.21.15.112:0/2963870233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 msgr2=0x7fb8cc066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/2963870233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc066110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fb8bc006fd0 tx=0x7fb8bc006e30).stop 2020-11-20T11:18:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 -- 172.21.15.112:0/2963870233 shutdown_connections 2020-11-20T11:18:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/2963870233 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc066110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 -- 172.21.15.112:0/2963870233 >> 172.21.15.112:0/2963870233 conn(0x7fb8cc05bac0 msgr2=0x7fb8cc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:12.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 -- 172.21.15.112:0/2963870233 shutdown_connections 2020-11-20T11:18:12.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.955+0000 7fb8d0c40700 1 -- 172.21.15.112:0/2963870233 wait complete. 2020-11-20T11:18:12.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.956+0000 7fb8d0c40700 1 Processor -- start 2020-11-20T11:18:12.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 -- start start 2020-11-20T11:18:12.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc1649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8cc1512e0 0x7fb8cc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc164ed0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc14d5b0 con 0x7fb8cc1512e0 2020-11-20T11:18:12.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8d0c40700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc14d850 con 0x7fb8cc065d30 2020-11-20T11:18:12.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8c9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8c9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51006/0 (socket says 172.21.15.112:51006) 2020-11-20T11:18:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8c9d9b700 1 -- 172.21.15.112:0/3852972172 learned_addr learned my addr 172.21.15.112:0/3852972172 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8cad9d700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8cc1512e0 0x7fb8cc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.957+0000 7fb8ca59c700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 -- 172.21.15.112:0/3852972172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 msgr2=0x7fb8cc1649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc1649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 -- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8cc1512e0 msgr2=0x7fb8cc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8cc1512e0 0x7fb8cc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 -- 172.21.15.112:0/3852972172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc14daf0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8c9d9b700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb8c000c710 tx=0x7fb8c0007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0001ea0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0013410 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc14dd90 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00137b0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.958+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc0c5af0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.959+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc0bed90 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.960+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb8c0010030 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.960+0000 7fb8ba7fc700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 0x7fb8a0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.960+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb8c00a24e0 con 0x7fb8cc0bfa50 2020-11-20T11:18:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.960+0000 7fb8ca59c700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 0x7fb8a0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.961+0000 7fb8ca59c700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 0x7fb8a0082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb8bc00b190 tx=0x7fb8bc015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:12.963+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb8c0076ef0 con 0x7fb8cc0bfa50 2020-11-20T11:18:13.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.103+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb8cc14e1f0 con 0x7fb8cc0bfa50 2020-11-20T11:18:13.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.103+0000 7fb8ba7fc700 1 -- 172.21.15.112:0/3852972172 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8c007a510 con 0x7fb8cc0bfa50 2020-11-20T11:18:13.105 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:13.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 msgr2=0x7fb8a0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 0x7fb8a0082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb8bc00b190 tx=0x7fb8bc015000).stop 2020-11-20T11:18:13.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 msgr2=0x7fb8cc0b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb8c000c710 tx=0x7fb8c0007c40).stop 2020-11-20T11:18:13.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 shutdown_connections 2020-11-20T11:18:13.108 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb8a0080670 0x7fb8a0082b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.108 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8cc1512e0 0x7fb8cc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.108 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8cc065d30 0x7fb8cc1649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.108 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 --2- 172.21.15.112:0/3852972172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8cc0bfa50 0x7fb8cc0b1300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.109 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 >> 172.21.15.112:0/3852972172 conn(0x7fb8cc05bac0 msgr2=0x7fb8cc152540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.109 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 shutdown_connections 2020-11-20T11:18:13.109 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.104+0000 7fb8d0c40700 1 -- 172.21.15.112:0/3852972172 wait complete. 2020-11-20T11:18:13.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411334 for osd.6 2020-11-20T11:18:13.118 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T11:18:13.229 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.227+0000 7f1f37677700 1 Processor -- start 2020-11-20T11:18:13.229 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.227+0000 7f1f37677700 1 -- start start 2020-11-20T11:18:13.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f30065d30 0x7f1f30066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 0x7f1f300c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f1f300c4c60 0x7f1f301512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f300c5230 con 0x7f1f30065d30 2020-11-20T11:18:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f301549c0 con 0x7f1f300c4c60 2020-11-20T11:18:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f37677700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f30154c60 con 0x7f1f300bfa50 2020-11-20T11:18:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f30065d30 0x7f1f30066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f30065d30 0x7f1f30066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51012/0 (socket says 172.21.15.112:51012) 2020-11-20T11:18:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 -- 172.21.15.112:0/1866146537 learned_addr learned my addr 172.21.15.112:0/1866146537 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f34c12700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 0x7f1f300c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 -- 172.21.15.112:0/1866146537 >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 msgr2=0x7f1f300c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 0x7f1f300c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 -- 172.21.15.112:0/1866146537 >> v2:172.21.15.166:3300/0 conn(0x7f1f300c4c60 msgr2=0x7f1f301512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.166:3300/0 conn(0x7f1f300c4c60 0x7f1f301512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 -- 172.21.15.112:0/1866146537 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30154f00 con 0x7f1f30065d30 2020-11-20T11:18:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f34c12700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 0x7f1f300c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f35413700 1 --2- 172.21.15.112:0/1866146537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f30065d30 0x7f1f30066110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1f300651b0 tx=0x7f1f20006ef0).ready entity=mon.0 client_cookie=3ac62aaee520a32c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f1ffff700 1 -- 172.21.15.112:0/1866146537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000b830 con 0x7f1f30065d30 2020-11-20T11:18:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f1ffff700 1 -- 172.21.15.112:0/1866146537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20000e90 con 0x7f1f30065d30 2020-11-20T11:18:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.228+0000 7f1f1ffff700 1 -- 172.21.15.112:0/1866146537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000bba0 con 0x7f1f30065d30 2020-11-20T11:18:13.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 -- 172.21.15.112:0/1866146537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f30065d30 msgr2=0x7f1f30066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 --2- 172.21.15.112:0/1866146537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f30065d30 0x7f1f30066110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1f300651b0 tx=0x7f1f20006ef0).stop 2020-11-20T11:18:13.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 -- 172.21.15.112:0/1866146537 shutdown_connections 2020-11-20T11:18:13.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.166:3300/0 conn(0x7f1f300c4c60 0x7f1f301512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:13.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 --2- 172.21.15.112:0/1866146537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f30065d30 0x7f1f30066110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 --2- 172.21.15.112:0/1866146537 >> v2:172.21.15.204:3300/0 conn(0x7f1f300bfa50 0x7f1f300c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 -- 172.21.15.112:0/1866146537 >> 172.21.15.112:0/1866146537 conn(0x7f1f3005bac0 msgr2=0x7f1f3005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 -- 172.21.15.112:0/1866146537 shutdown_connections 2020-11-20T11:18:13.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.229+0000 7f1f37677700 1 -- 172.21.15.112:0/1866146537 wait complete. 2020-11-20T11:18:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.230+0000 7f1f37677700 1 Processor -- start 2020-11-20T11:18:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.230+0000 7f1f37677700 1 -- start start 2020-11-20T11:18:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 0x7f1f30153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f300c4c60 0x7f1f3014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301535b0 con 0x7f1f300bfa50 2020-11-20T11:18:13.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30161c80 con 0x7f1f30065d30 2020-11-20T11:18:13.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f37677700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b1560 con 0x7f1f300c4c60 2020-11-20T11:18:13.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51016/0 (socket says 172.21.15.112:51016) 2020-11-20T11:18:13.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 -- 172.21.15.112:0/88845595 learned_addr learned my addr 172.21.15.112:0/88845595 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:13.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f35413700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 0x7f1f30153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 -- 172.21.15.112:0/88845595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f300c4c60 msgr2=0x7f1f3014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f35c14700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f300c4c60 0x7f1f3014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f300c4c60 0x7f1f3014cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 -- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 msgr2=0x7f1f30153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 0x7f1f30153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f34c12700 1 -- 172.21.15.112:0/88845595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300b17c0 con 0x7f1f300bfa50 2020-11-20T11:18:13.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.231+0000 7f1f35413700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 0x7f1f30153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:13.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f34c12700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1f2c00cb20 tx=0x7f1f2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c007740 con 0x7f1f300bfa50 2020-11-20T11:18:13.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0078a0 con 0x7f1f300bfa50 2020-11-20T11:18:13.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f300b1a60 con 0x7f1f300bfa50 2020-11-20T11:18:13.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c007c20 con 0x7f1f300bfa50 2020-11-20T11:18:13.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.232+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f30161eb0 con 0x7f1f300bfa50 2020-11-20T11:18:13.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.233+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f30162070 con 0x7f1f300bfa50 2020-11-20T11:18:13.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.233+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1f2c01b460 con 0x7f1f300bfa50 2020-11-20T11:18:13.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.234+0000 7f1f1d7fa700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 0x7f1f08082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.234+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1f2c0a2be0 con 0x7f1f300bfa50 2020-11-20T11:18:13.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.234+0000 7f1f35413700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 0x7f1f08082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.235+0000 7f1f35413700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 0x7f1f08082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1f20006f30 tx=0x7f1f20016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.248 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.238+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1f2c077590 con 0x7f1f300bfa50 2020-11-20T11:18:13.379 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.377+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1f30065740 con 0x7f1f300bfa50 2020-11-20T11:18:13.379 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.377+0000 7f1f1d7fa700 1 -- 172.21.15.112:0/88845595 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f2c07abb0 con 0x7f1f300bfa50 2020-11-20T11:18:13.379 INFO:teuthology.orchestra.run.smithi112.stdout:77309411335 2020-11-20T11:18:13.380 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 msgr2=0x7f1f08082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 0x7f1f08082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1f20006f30 tx=0x7f1f20016000).stop 2020-11-20T11:18:13.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 msgr2=0x7f1f301530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1f2c00cb20 tx=0x7f1f2c008040).stop 2020-11-20T11:18:13.381 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 shutdown_connections 2020-11-20T11:18:13.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1f08080670 0x7f1f08082b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f300c4c60 0x7f1f3014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1f30065d30 0x7f1f30153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 --2- 172.21.15.112:0/88845595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300bfa50 0x7f1f301530c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.382 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.378+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 >> 172.21.15.112:0/88845595 conn(0x7f1f3005bac0 msgr2=0x7f1f300c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.379+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 shutdown_connections 2020-11-20T11:18:13.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.379+0000 7f1f37677700 1 -- 172.21.15.112:0/88845595 wait complete. 2020-11-20T11:18:13.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411335 for osd.7 2020-11-20T11:18:13.392 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T11:18:13.500 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.499+0000 7f72ff61d700 1 Processor -- start 2020-11-20T11:18:13.501 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.499+0000 7f72ff61d700 1 -- start start 2020-11-20T11:18:13.503 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72ff61d700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 0x7f72f80bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.503 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72ff61d700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f72f81512e0 0x7f72f8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.503 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72ff61d700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80c5230 con 0x7f72f8065d30 2020-11-20T11:18:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72ff61d700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80bff40 con 0x7f72f81512e0 2020-11-20T11:18:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72ff61d700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f81549c0 con 0x7f72f8066110 2020-11-20T11:18:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f72f81512e0 0x7f72f8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f72f81512e0 0x7f72f8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:39022/0 (socket says 172.21.15.112:39022) 2020-11-20T11:18:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 -- 172.21.15.112:0/3162163564 learned_addr learned my addr 172.21.15.112:0/3162163564 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fd3b9700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f72f8065d30 0x7f72f80c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45872/0 (socket says 172.21.15.112:45872) 2020-11-20T11:18:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fcbb8700 1 --2- 172.21.15.112:0/3162163564 >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 0x7f72f80bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 -- 172.21.15.112:0/3162163564 >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 msgr2=0x7f72f80bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 --2- 172.21.15.112:0/3162163564 >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 0x7f72f80bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 -- 172.21.15.112:0/3162163564 >> v1:172.21.15.166:6789/0 conn(0x7f72f8065d30 legacy=0x7f72f80c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fdbba700 1 -- 172.21.15.112:0/3162163564 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8154c60 con 0x7f72f81512e0 2020-11-20T11:18:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.500+0000 7f72fcbb8700 1 --2- 172.21.15.112:0/3162163564 >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 0x7f72f80bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:18:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72fdbba700 1 --2- 172.21.15.112:0/3162163564 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f81512e0 0x7f72f8151710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f72f80651b0 tx=0x7f72f00092d0).ready entity=mon.1 client_cookie=a1384be0e91c82f4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72e7fff700 1 -- 172.21.15.112:0/3162163564 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000bbf0 con 0x7f72f81512e0 2020-11-20T11:18:13.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72e7fff700 1 -- 172.21.15.112:0/3162163564 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000bd50 con 0x7f72f81512e0 2020-11-20T11:18:13.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72e7fff700 1 -- 172.21.15.112:0/3162163564 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0011610 con 0x7f72f81512e0 2020-11-20T11:18:13.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 -- 172.21.15.112:0/3162163564 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f81512e0 msgr2=0x7f72f8151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 --2- 172.21.15.112:0/3162163564 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f81512e0 0x7f72f8151710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f72f80651b0 tx=0x7f72f00092d0).stop 2020-11-20T11:18:13.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 -- 172.21.15.112:0/3162163564 shutdown_connections 2020-11-20T11:18:13.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 --2- 172.21.15.112:0/3162163564 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f81512e0 0x7f72f8151710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 --2- 172.21.15.112:0/3162163564 >> v2:172.21.15.204:3300/0 conn(0x7f72f8066110 0x7f72f80bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 -- 172.21.15.112:0/3162163564 >> 172.21.15.112:0/3162163564 conn(0x7f72f805bac0 msgr2=0x7f72f805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 -- 172.21.15.112:0/3162163564 shutdown_connections 2020-11-20T11:18:13.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.501+0000 7f72ff61d700 1 -- 172.21.15.112:0/3162163564 wait complete. 2020-11-20T11:18:13.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.502+0000 7f72ff61d700 1 Processor -- start 2020-11-20T11:18:13.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.502+0000 7f72ff61d700 1 -- start start 2020-11-20T11:18:13.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f8065d30 0x7f72f814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f8066110 0x7f72f814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.512 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8160780 con 0x7f72f81512e0 2020-11-20T11:18:13.512 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8160a20 con 0x7f72f8065d30 2020-11-20T11:18:13.512 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72ff61d700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8160cc0 con 0x7f72f8066110 2020-11-20T11:18:13.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72fdbba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72fdbba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51032/0 (socket says 172.21.15.112:51032) 2020-11-20T11:18:13.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72fdbba700 1 -- 172.21.15.112:0/115022138 learned_addr learned my addr 172.21.15.112:0/115022138 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:13.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.503+0000 7f72fd3b9700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f8065d30 0x7f72f814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fcbb8700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f8066110 0x7f72f814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 -- 172.21.15.112:0/115022138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f8066110 msgr2=0x7f72f814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f8066110 0x7f72f814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.514 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 -- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f8065d30 msgr2=0x7f72f814ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f8065d30 0x7f72f814ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 -- 172.21.15.112:0/115022138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8160f60 con 0x7f72f81512e0 2020-11-20T11:18:13.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72fdbba700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f72f0009310 tx=0x7f72f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f001b6b0 con 0x7f72f81512e0 2020-11-20T11:18:13.515 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f001b810 con 0x7f72f81512e0 2020-11-20T11:18:13.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f8161200 con 0x7f72f81512e0 2020-11-20T11:18:13.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f001bb90 con 0x7f72f81512e0 2020-11-20T11:18:13.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.504+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f814dd60 con 0x7f72f81512e0 2020-11-20T11:18:13.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.505+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f8065740 con 0x7f72f81512e0 2020-11-20T11:18:13.516 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.506+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f72f0017070 con 0x7f72f81512e0 2020-11-20T11:18:13.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.506+0000 7f72e57fa700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 0x7f72d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.506+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f72f00a4870 con 0x7f72f81512e0 2020-11-20T11:18:13.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.506+0000 7f72fd3b9700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 0x7f72d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.517 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.507+0000 7f72fd3b9700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 0x7f72d0082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f72f8163b10 tx=0x7f72e8000bc0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.518 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.510+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f72f0079280 con 0x7f72f81512e0 2020-11-20T11:18:13.651 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.649+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f72f80666c0 con 0x7f72f81512e0 2020-11-20T11:18:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.650+0000 7f72e57fa700 1 -- 172.21.15.112:0/115022138 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72f0015030 con 0x7f72f81512e0 2020-11-20T11:18:13.652 INFO:teuthology.orchestra.run.smithi112.stdout:77309411335 2020-11-20T11:18:13.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 msgr2=0x7f72d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.653 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 0x7f72d0082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f72f8163b10 tx=0x7f72e8000bc0).stop 2020-11-20T11:18:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 msgr2=0x7f72f814d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f72f0009310 tx=0x7f72f0016000).stop 2020-11-20T11:18:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 shutdown_connections 2020-11-20T11:18:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f72d0080670 0x7f72d0082b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f81512e0 0x7f72f814d870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f72f8065d30 0x7f72f814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 --2- 172.21.15.112:0/115022138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f8066110 0x7f72f814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 >> 172.21.15.112:0/115022138 conn(0x7f72f805bac0 msgr2=0x7f72f814fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 shutdown_connections 2020-11-20T11:18:13.655 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.651+0000 7f72ff61d700 1 -- 172.21.15.112:0/115022138 wait complete. 2020-11-20T11:18:13.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411335 for osd.8 2020-11-20T11:18:13.665 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T11:18:13.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.773+0000 7fabc3253700 1 Processor -- start 2020-11-20T11:18:13.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.773+0000 7fabc3253700 1 -- start start 2020-11-20T11:18:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc3253700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fabbc0c7df0 0x7fabbc0601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc3253700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc060790 con 0x7fabbc0c4810 2020-11-20T11:18:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc3253700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc060a30 con 0x7fabbc0c7a10 2020-11-20T11:18:13.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc3253700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc0c4150 con 0x7fabbc0c7df0 2020-11-20T11:18:13.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc2a52700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7fabbc0c4810 0x7fabbc0c4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45888/0 (socket says 172.21.15.112:45888) 2020-11-20T11:18:13.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc2a52700 1 -- 172.21.15.112:0/1165833068 learned_addr learned my addr 172.21.15.112:0/1165833068 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:13.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc1a50700 1 --2- 172.21.15.112:0/1165833068 >> v2:172.21.15.204:3300/0 conn(0x7fabbc0c7df0 0x7fabbc0601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996362256 0 0) 0x7fabbc060790 con 0x7fabbc0c4810 2020-11-20T11:18:13.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba4003280 con 0x7fabbc0c4810 2020-11-20T11:18:13.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc1a50700 1 -- 172.21.15.112:0/1165833068 >> v1:172.21.15.204:6789/0 conn(0x7fabbc0c7a10 legacy=0x7fabbc0bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550722478 0 0) 0x7fabbc060a30 con 0x7fabbc0c7a10 2020-11-20T11:18:13.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc1a50700 1 -- 172.21.15.112:0/1165833068 >> v1:172.21.15.166:6789/0 conn(0x7fabbc0c4810 legacy=0x7fabbc0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc1a50700 1 -- 172.21.15.112:0/1165833068 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc060cd0 con 0x7fabbc0c7df0 2020-11-20T11:18:13.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.774+0000 7fabc1a50700 1 --2- 172.21.15.112:0/1165833068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0601b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fabb8006fd0 tx=0x7fabb8006e30).ready entity=mon.2 client_cookie=8323b994b04cf47c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800bec0 con 0x7fabbc0c7df0 2020-11-20T11:18:13.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8000e90 con 0x7fabbc0c7df0 2020-11-20T11:18:13.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc124f700 1 -- 172.21.15.112:0/1165833068 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80099f0 con 0x7fabbc0c7df0 2020-11-20T11:18:13.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 -- 172.21.15.112:0/1165833068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 msgr2=0x7fabbc0601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 --2- 172.21.15.112:0/1165833068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0601b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fabb8006fd0 tx=0x7fabb8006e30).stop 2020-11-20T11:18:13.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 -- 172.21.15.112:0/1165833068 shutdown_connections 2020-11-20T11:18:13.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 --2- 172.21.15.112:0/1165833068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0601b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 -- 172.21.15.112:0/1165833068 >> 172.21.15.112:0/1165833068 conn(0x7fabbc05bac0 msgr2=0x7fabbc062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 -- 172.21.15.112:0/1165833068 shutdown_connections 2020-11-20T11:18:13.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.775+0000 7fabc3253700 1 -- 172.21.15.112:0/1165833068 wait complete. 2020-11-20T11:18:13.802 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.776+0000 7fabc3253700 1 Processor -- start 2020-11-20T11:18:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.776+0000 7fabc3253700 1 -- start start 2020-11-20T11:18:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 0x7fabbc0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c6420 con 0x7fabbc0c7a10 2020-11-20T11:18:13.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c66c0 con 0x7fabbc0c4810 2020-11-20T11:18:13.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc3253700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc160860 con 0x7fabbc0c7df0 2020-11-20T11:18:13.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51044/0 (socket says 172.21.15.112:51044) 2020-11-20T11:18:13.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 -- 172.21.15.112:0/343871568 learned_addr learned my addr 172.21.15.112:0/343871568 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:13.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc2251700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 0x7fabbc0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc2a52700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 -- 172.21.15.112:0/343871568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 msgr2=0x7fabbc0c0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0c0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 -- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 msgr2=0x7fabbc0c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.777+0000 7fabc1a50700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 0x7fabbc0c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabc1a50700 1 -- 172.21.15.112:0/343871568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc160b00 con 0x7fabbc0c7a10 2020-11-20T11:18:13.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabc2251700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 0x7fabbc0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:18:13.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabc1a50700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fabbc0645d0 tx=0x7fabb8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011a70 con 0x7fabbc0c7a10 2020-11-20T11:18:13.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8011bd0 con 0x7fabbc0c7a10 2020-11-20T11:18:13.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc160da0 con 0x7fabbc0c7a10 2020-11-20T11:18:13.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb801d3c0 con 0x7fabbc0c7a10 2020-11-20T11:18:13.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.778+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0c0a60 con 0x7fabbc0c7a10 2020-11-20T11:18:13.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.779+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc061740 con 0x7fabbc0c7a10 2020-11-20T11:18:13.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.779+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fabb801a040 con 0x7fabbc0c7a10 2020-11-20T11:18:13.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.780+0000 7fabaa7fc700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 0x7fab94082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:13.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.780+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fabb80a3b90 con 0x7fabbc0c7a10 2020-11-20T11:18:13.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.780+0000 7fabc2251700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 0x7fab94082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:13.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.781+0000 7fabc2251700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 0x7fab94082b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fabac001220 tx=0x7fabac009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:13.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.783+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fabb80785a0 con 0x7fabbc0c7a10 2020-11-20T11:18:13.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.923+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fabbc160f30 con 0x7fabbc0c7a10 2020-11-20T11:18:13.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.923+0000 7fabaa7fc700 1 -- 172.21.15.112:0/343871568 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabb807bbc0 con 0x7fabbc0c7a10 2020-11-20T11:18:13.926 INFO:teuthology.orchestra.run.smithi112.stdout:77309411334 2020-11-20T11:18:13.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 msgr2=0x7fab94082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.928 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 0x7fab94082b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fabac001220 tx=0x7fabac009040).stop 2020-11-20T11:18:13.928 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 msgr2=0x7fabbc161240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:13.929 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fabbc0645d0 tx=0x7fabb8015000).stop 2020-11-20T11:18:13.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 shutdown_connections 2020-11-20T11:18:13.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fab940806a0 0x7fab94082b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fabbc0c7df0 0x7fabbc0c0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fabbc0c4810 0x7fabbc0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 --2- 172.21.15.112:0/343871568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc0c7a10 0x7fabbc161240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:13.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 >> 172.21.15.112:0/343871568 conn(0x7fabbc05bac0 msgr2=0x7fabbc0c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:13.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 shutdown_connections 2020-11-20T11:18:13.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:13.925+0000 7fabc3253700 1 -- 172.21.15.112:0/343871568 wait complete. 2020-11-20T11:18:13.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411333 got 77309411334 for osd.9 2020-11-20T11:18:13.938 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T11:18:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.056+0000 7f2fe6035700 1 Processor -- start 2020-11-20T11:18:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.056+0000 7f2fe6035700 1 -- start start 2020-11-20T11:18:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fe6035700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f2fe0066110 0x7f2fe00bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fe6035700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00c5230 con 0x7f2fe0065d30 2020-11-20T11:18:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fe6035700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe01549c0 con 0x7f2fe01512e0 2020-11-20T11:18:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fe6035700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe00bff40 con 0x7f2fe0066110 2020-11-20T11:18:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fdf7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2fe0065d30 0x7f2fe00c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35244/0 (socket says 172.21.15.112:35244) 2020-11-20T11:18:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/340583782 learned_addr learned my addr 172.21.15.112:0/340583782 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/340583782 >> v2:172.21.15.166:3300/0 conn(0x7f2fe0066110 0x7f2fe00bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753967739 0 0) 0x7f2fe00c5230 con 0x7f2fe0065d30 2020-11-20T11:18:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.057+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fcc003280 con 0x7f2fe0065d30 2020-11-20T11:18:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 765723040 0 0) 0x7f2fcc003280 con 0x7f2fe0065d30 2020-11-20T11:18:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 >> v2:172.21.15.166:3300/0 conn(0x7f2fe0066110 msgr2=0x7f2fe00bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 --2- 172.21.15.112:0/340583782 >> v2:172.21.15.166:3300/0 conn(0x7f2fe0066110 0x7f2fe00bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 >> v1:172.21.15.204:6789/0 conn(0x7f2fe01512e0 legacy=0x7f2fe0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0154c60 con 0x7f2fe0065d30 2020-11-20T11:18:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f2fd0001520 con 0x7f2fe0065d30 2020-11-20T11:18:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 >> v1:172.21.15.112:6789/0 conn(0x7f2fe0065d30 legacy=0x7f2fe00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fcc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fcc004520 0x7f2fcc0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fcc004e90 0x7f2fcc00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00bff40 con 0x7f2fcc003770 2020-11-20T11:18:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc004260 con 0x7f2fcc004520 2020-11-20T11:18:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc00bc60 con 0x7f2fcc004e90 2020-11-20T11:18:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fcc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdffff700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fcc004e90 0x7f2fcc00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fcc004520 0x7f2fcc0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/340583782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fcc004e90 msgr2=0x7f2fcc00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fcc004e90 0x7f2fcc00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/340583782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fcc004520 msgr2=0x7f2fcc0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fcc004520 0x7f2fcc0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdffff700 1 -- 172.21.15.112:0/340583782 reap_dead start 2020-11-20T11:18:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/340583782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc003280 con 0x7f2fcc003770 2020-11-20T11:18:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fcc003b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2fd000c440 tx=0x7f2fe0154df0).ready entity=mon.0 client_cookie=c30c0d1f8c36422a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00070d0 con 0x7f2fcc003770 2020-11-20T11:18:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0007230 con 0x7f2fcc003770 2020-11-20T11:18:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.058+0000 7f2fde7fc700 1 -- 172.21.15.112:0/340583782 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0005630 con 0x7f2fcc003770 2020-11-20T11:18:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 -- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 msgr2=0x7f2fcc003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fcc003b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2fd000c440 tx=0x7f2fe0154df0).stop 2020-11-20T11:18:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 -- 172.21.15.112:0/340583782 shutdown_connections 2020-11-20T11:18:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 --2- 172.21.15.112:0/340583782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fcc003b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 -- 172.21.15.112:0/340583782 >> 172.21.15.112:0/340583782 conn(0x7f2fe005bac0 msgr2=0x7f2fe005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 -- 172.21.15.112:0/340583782 shutdown_connections 2020-11-20T11:18:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.059+0000 7f2fe6035700 1 -- 172.21.15.112:0/340583782 wait complete. 2020-11-20T11:18:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.060+0000 7f2fe6035700 1 Processor -- start 2020-11-20T11:18:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.060+0000 7f2fe6035700 1 -- start start 2020-11-20T11:18:14.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 0x7f2fe00b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fe00b2200 0x7f2fe014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c3460 con 0x7f2fcc003770 2020-11-20T11:18:14.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c2c80 con 0x7f2fe00c2430 2020-11-20T11:18:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fe6035700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00c2f20 con 0x7f2fe00b2200 2020-11-20T11:18:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51062/0 (socket says 172.21.15.112:51062) 2020-11-20T11:18:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/3863067595 learned_addr learned my addr 172.21.15.112:0/3863067595 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdffff700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fe00b2200 0x7f2fe014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 0x7f2fe00b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/3863067595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fe00b2200 msgr2=0x7f2fe014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fe00b2200 0x7f2fe014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 msgr2=0x7f2fe00b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 0x7f2fe00b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 -- 172.21.15.112:0/3863067595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00c31c0 con 0x7f2fcc003770 2020-11-20T11:18:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 0x7f2fe00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fdf7fe700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2fd000ca30 tx=0x7f2fd0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.061+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd001b070 con 0x7f2fcc003770 2020-11-20T11:18:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.062+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0001700 con 0x7f2fcc003770 2020-11-20T11:18:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.062+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe0161a80 con 0x7f2fcc003770 2020-11-20T11:18:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.062+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00075b0 con 0x7f2fcc003770 2020-11-20T11:18:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.062+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe0161430 con 0x7f2fcc003770 2020-11-20T11:18:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.062+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe01618f0 con 0x7f2fcc003770 2020-11-20T11:18:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.063+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2fd0010070 con 0x7f2fcc003770 2020-11-20T11:18:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.064+0000 7f2fbf7fe700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 0x7f2fb8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.064+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2fd00a3560 con 0x7f2fcc003770 2020-11-20T11:18:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.064+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 0x7f2fb8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.064+0000 7f2fdeffd700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 0x7f2fb8082b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2fe00c0f70 tx=0x7f2fd4008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.067+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2fd0077f70 con 0x7f2fcc003770 2020-11-20T11:18:14.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.206+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f2fe0065740 con 0x7f2fcc003770 2020-11-20T11:18:14.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.207+0000 7f2fbf7fe700 1 -- 172.21.15.112:0/3863067595 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f2fd007b590 con 0x7f2fcc003770 2020-11-20T11:18:14.209 INFO:teuthology.orchestra.run.smithi112.stdout:77309411335 2020-11-20T11:18:14.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 msgr2=0x7f2fb8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 0x7f2fb8082b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2fe00c0f70 tx=0x7f2fd4008040).stop 2020-11-20T11:18:14.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 msgr2=0x7f2fe0160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2fd000ca30 tx=0x7f2fd0013000).stop 2020-11-20T11:18:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 shutdown_connections 2020-11-20T11:18:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f2fb8080670 0x7f2fb8082b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fe00b2200 0x7f2fe014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fcc003770 0x7f2fe0160f40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 --2- 172.21.15.112:0/3863067595 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2fe00c2430 0x7f2fe00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 >> 172.21.15.112:0/3863067595 conn(0x7f2fe005bac0 msgr2=0x7f2fe01516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 shutdown_connections 2020-11-20T11:18:14.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.208+0000 7f2fe6035700 1 -- 172.21.15.112:0/3863067595 wait complete. 2020-11-20T11:18:14.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411335 for osd.10 2020-11-20T11:18:14.222 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T11:18:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.330+0000 7fb999a8a700 1 Processor -- start 2020-11-20T11:18:14.333 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.330+0000 7fb999a8a700 1 -- start start 2020-11-20T11:18:14.336 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb999a8a700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fb994065d30 0x7fb994066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.336 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb999a8a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9940c5230 con 0x7fb9941512e0 2020-11-20T11:18:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb999a8a700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9941549c0 con 0x7fb9940bfa50 2020-11-20T11:18:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb999a8a700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb994154c60 con 0x7fb994065d30 2020-11-20T11:18:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb993fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9941512e0 0x7fb994151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35266/0 (socket says 172.21.15.112:35266) 2020-11-20T11:18:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.331+0000 7fb993fff700 1 -- 172.21.15.112:0/2609016412 learned_addr learned my addr 172.21.15.112:0/2609016412 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 --2- 172.21.15.112:0/2609016412 >> v2:172.21.15.166:3300/0 conn(0x7fb994065d30 0x7fb994066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436764964 0 0) 0x7fb9940c5230 con 0x7fb9941512e0 2020-11-20T11:18:14.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb980003280 con 0x7fb9941512e0 2020-11-20T11:18:14.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2330012551 0 0) 0x7fb980003280 con 0x7fb9941512e0 2020-11-20T11:18:14.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 >> v2:172.21.15.166:3300/0 conn(0x7fb994065d30 msgr2=0x7fb994066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 --2- 172.21.15.112:0/2609016412 >> v2:172.21.15.166:3300/0 conn(0x7fb994065d30 0x7fb994066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 >> v1:172.21.15.204:6789/0 conn(0x7fb9940bfa50 legacy=0x7fb9940c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994154f00 con 0x7fb9941512e0 2020-11-20T11:18:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fb98c0018a0 con 0x7fb9941512e0 2020-11-20T11:18:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 >> v1:172.21.15.112:6789/0 conn(0x7fb9941512e0 legacy=0x7fb994151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 0x7fb980003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980004520 0x7fb9800049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb980004e90 0x7fb98000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994154c60 con 0x7fb980003770 2020-11-20T11:18:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb980005370 con 0x7fb980004e90 2020-11-20T11:18:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98000bc60 con 0x7fb980004520 2020-11-20T11:18:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 0x7fb980003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb992ffd700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980004520 0x7fb9800049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb993fff700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb980004e90 0x7fb98000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 -- 172.21.15.112:0/2609016412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980004520 msgr2=0x7fb9800049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980004520 0x7fb9800049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 -- 172.21.15.112:0/2609016412 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb980004e90 msgr2=0x7fb98000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb980004e90 0x7fb98000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 -- 172.21.15.112:0/2609016412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980003280 con 0x7fb980003770 2020-11-20T11:18:14.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb992ffd700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980004520 0x7fb9800049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb993fff700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb980004e90 0x7fb98000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb993fff700 1 -- 172.21.15.112:0/2609016412 reap_dead start 2020-11-20T11:18:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9937fe700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 0x7fb980003b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb98400bc40 tx=0x7fb984006e30).ready entity=mon.0 client_cookie=767727b137c51cd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400b350 con 0x7fb980003770 2020-11-20T11:18:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.332+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98400eab0 con 0x7fb980003770 2020-11-20T11:18:14.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb9927fc700 1 -- 172.21.15.112:0/2609016412 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400ee30 con 0x7fb980003770 2020-11-20T11:18:14.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 -- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 msgr2=0x7fb980003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 0x7fb980003b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb98400bc40 tx=0x7fb984006e30).stop 2020-11-20T11:18:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 -- 172.21.15.112:0/2609016412 shutdown_connections 2020-11-20T11:18:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 --2- 172.21.15.112:0/2609016412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb980003770 0x7fb980003b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 -- 172.21.15.112:0/2609016412 >> 172.21.15.112:0/2609016412 conn(0x7fb99405bac0 msgr2=0x7fb99405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 -- 172.21.15.112:0/2609016412 shutdown_connections 2020-11-20T11:18:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.333+0000 7fb999a8a700 1 -- 172.21.15.112:0/2609016412 wait complete. 2020-11-20T11:18:14.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.334+0000 7fb999a8a700 1 Processor -- start 2020-11-20T11:18:14.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.334+0000 7fb999a8a700 1 -- start start 2020-11-20T11:18:14.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 0x7fb994161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb9940c4870 0x7fb994161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994164ba0 con 0x7fb9940b5e90 2020-11-20T11:18:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9941607b0 con 0x7fb9940c4870 2020-11-20T11:18:14.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb999a8a700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940b6390 con 0x7fb980003770 2020-11-20T11:18:14.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51082/0 (socket says 172.21.15.112:51082) 2020-11-20T11:18:14.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 -- 172.21.15.112:0/1515578817 learned_addr learned my addr 172.21.15.112:0/1515578817 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:14.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb9937fe700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 0x7fb994161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb993fff700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb9940c4870 0x7fb994161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 -- 172.21.15.112:0/1515578817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 msgr2=0x7fb994161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 0x7fb994161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 -- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb9940c4870 msgr2=0x7fb994161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb9940c4870 0x7fb994161bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb992ffd700 1 -- 172.21.15.112:0/1515578817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940b6630 con 0x7fb9940b5e90 2020-11-20T11:18:14.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.335+0000 7fb9937fe700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 0x7fb994161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb992ffd700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb988007850 tx=0x7fb988009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800c5b0 con 0x7fb9940b5e90 2020-11-20T11:18:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98800c710 con 0x7fb9940b5e90 2020-11-20T11:18:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb994160a40 con 0x7fb9940b5e90 2020-11-20T11:18:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800ca90 con 0x7fb9940b5e90 2020-11-20T11:18:14.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.336+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb994160f80 con 0x7fb9940b5e90 2020-11-20T11:18:14.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.337+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9940c1790 con 0x7fb9940b5e90 2020-11-20T11:18:14.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.337+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb988014430 con 0x7fb9940b5e90 2020-11-20T11:18:14.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.338+0000 7fb9737fe700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 0x7fb96c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.338+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb9880a2f90 con 0x7fb9940b5e90 2020-11-20T11:18:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.338+0000 7fb9937fe700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 0x7fb96c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.338+0000 7fb9937fe700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 0x7fb96c082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb984006e70 tx=0x7fb984019000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.340+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb988077940 con 0x7fb9940b5e90 2020-11-20T11:18:14.481 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.480+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fb994065740 con 0x7fb9940b5e90 2020-11-20T11:18:14.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.480+0000 7fb9737fe700 1 -- 172.21.15.112:0/1515578817 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fb988022030 con 0x7fb9940b5e90 2020-11-20T11:18:14.482 INFO:teuthology.orchestra.run.smithi112.stdout:77309411335 2020-11-20T11:18:14.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.481+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 msgr2=0x7fb96c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.481+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 0x7fb96c082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb984006e70 tx=0x7fb984019000).stop 2020-11-20T11:18:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.481+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 msgr2=0x7fb9941646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.481+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb988007850 tx=0x7fb988009040).stop 2020-11-20T11:18:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 shutdown_connections 2020-11-20T11:18:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb96c080670 0x7fb96c082b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb9940c4870 0x7fb994161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb980003770 0x7fb994161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 --2- 172.21.15.112:0/1515578817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9940b5e90 0x7fb9941646b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 >> 172.21.15.112:0/1515578817 conn(0x7fb99405bac0 msgr2=0x7fb99414e200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 shutdown_connections 2020-11-20T11:18:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.482+0000 7fb999a8a700 1 -- 172.21.15.112:0/1515578817 wait complete. 2020-11-20T11:18:14.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411334 got 77309411335 for osd.11 2020-11-20T11:18:14.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T11:18:14.495 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:18:14.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.602+0000 7fae31653700 1 Processor -- start 2020-11-20T11:18:14.604 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.602+0000 7fae31653700 1 -- start start 2020-11-20T11:18:14.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae31653700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae2c064a10 0x7fae2c064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae31653700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fae2c14e310 0x7fae2c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.610 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae31653700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c154bc0 con 0x7fae2c0c4670 2020-11-20T11:18:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae31653700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0c02b0 con 0x7fae2c14e310 2020-11-20T11:18:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae31653700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c154e60 con 0x7fae2c064a10 2020-11-20T11:18:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fae2c0c4670 0x7fae2c0bfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35284/0 (socket says 172.21.15.112:35284) 2020-11-20T11:18:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2b7fe700 1 -- 172.21.15.112:0/583796900 learned_addr learned my addr 172.21.15.112:0/583796900 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:14.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665791519 0 0) 0x7fae2c154bc0 con 0x7fae2c0c4670 2020-11-20T11:18:14.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae30e52700 1 --2- 172.21.15.112:0/583796900 >> v2:172.21.15.166:3300/0 conn(0x7fae2c14e310 0x7fae2c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae18003280 con 0x7fae2c0c4670 2020-11-20T11:18:14.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2bfff700 1 --2- 172.21.15.112:0/583796900 >> v2:172.21.15.204:3300/0 conn(0x7fae2c064a10 0x7fae2c064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1692980633 0 0) 0x7fae18003280 con 0x7fae2c0c4670 2020-11-20T11:18:14.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 >> v2:172.21.15.204:3300/0 conn(0x7fae2c064a10 msgr2=0x7fae2c064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 --2- 172.21.15.112:0/583796900 >> v2:172.21.15.204:3300/0 conn(0x7fae2c064a10 0x7fae2c064df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.613 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 >> v2:172.21.15.166:3300/0 conn(0x7fae2c14e310 msgr2=0x7fae2c14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 --2- 172.21.15.112:0/583796900 >> v2:172.21.15.166:3300/0 conn(0x7fae2c14e310 0x7fae2c14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c155100 con 0x7fae2c0c4670 2020-11-20T11:18:14.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fae20001520 con 0x7fae2c0c4670 2020-11-20T11:18:14.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 >> v1:172.21.15.112:6789/0 conn(0x7fae2c0c4670 legacy=0x7fae2c0bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.603+0000 7fae2affd700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae180037c0 0x7fae18003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae18004520 0x7fae180049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 0x7fae1800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c02b0 con 0x7fae18004e90 2020-11-20T11:18:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c154e60 con 0x7fae180037c0 2020-11-20T11:18:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180053f0 con 0x7fae18004520 2020-11-20T11:18:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 0x7fae1800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2bfff700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae180037c0 0x7fae18003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2b7fe700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae18004520 0x7fae180049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 -- 172.21.15.112:0/583796900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae18004520 msgr2=0x7fae180049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae18004520 0x7fae180049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 -- 172.21.15.112:0/583796900 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae180037c0 msgr2=0x7fae18003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae180037c0 0x7fae18003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 -- 172.21.15.112:0/583796900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18003280 con 0x7fae18004e90 2020-11-20T11:18:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 -- 172.21.15.112:0/583796900 reap_dead start 2020-11-20T11:18:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae30e52700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 0x7fae1800b770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fae24009ed0 tx=0x7fae24009220).ready entity=mon.0 client_cookie=f57afe4165acd15f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240095f0 con 0x7fae18004e90 2020-11-20T11:18:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400ec80 con 0x7fae18004e90 2020-11-20T11:18:14.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.604+0000 7fae2affd700 1 -- 172.21.15.112:0/583796900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240123f0 con 0x7fae18004e90 2020-11-20T11:18:14.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 -- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 msgr2=0x7fae1800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 0x7fae1800b770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fae24009ed0 tx=0x7fae24009220).stop 2020-11-20T11:18:14.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 -- 172.21.15.112:0/583796900 shutdown_connections 2020-11-20T11:18:14.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 --2- 172.21.15.112:0/583796900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae18004e90 0x7fae1800b770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 -- 172.21.15.112:0/583796900 >> 172.21.15.112:0/583796900 conn(0x7fae2c060820 msgr2=0x7fae2c05bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 -- 172.21.15.112:0/583796900 shutdown_connections 2020-11-20T11:18:14.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.605+0000 7fae31653700 1 -- 172.21.15.112:0/583796900 wait complete. 2020-11-20T11:18:14.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.606+0000 7fae31653700 1 Processor -- start 2020-11-20T11:18:14.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.606+0000 7fae31653700 1 -- start start 2020-11-20T11:18:14.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 0x7fae2c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae2c0be6d0 0x7fae2c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1607e0 con 0x7fae2c154480 2020-11-20T11:18:14.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c160a80 con 0x7fae18004e90 2020-11-20T11:18:14.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c160d20 con 0x7fae2c0be6d0 2020-11-20T11:18:14.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51104/0 (socket says 172.21.15.112:51104) 2020-11-20T11:18:14.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 -- 172.21.15.112:0/2597920384 learned_addr learned my addr 172.21.15.112:0/2597920384 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:14.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2bfff700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 0x7fae2c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 -- 172.21.15.112:0/2597920384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae2c0be6d0 msgr2=0x7fae2c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae2c0be6d0 0x7fae2c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:14.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 -- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 msgr2=0x7fae2c153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 0x7fae2c153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 -- 172.21.15.112:0/2597920384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c160fc0 con 0x7fae2c154480 2020-11-20T11:18:14.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2bfff700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 0x7fae2c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae2b7fe700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fae20001200 tx=0x7fae2c154d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000f8e0 con 0x7fae2c154480 2020-11-20T11:18:14.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000fa60 con 0x7fae2c154480 2020-11-20T11:18:14.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c161260 con 0x7fae2c154480 2020-11-20T11:18:14.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000fe20 con 0x7fae2c154480 2020-11-20T11:18:14.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.607+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c14f230 con 0x7fae2c154480 2020-11-20T11:18:14.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.608+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c0008d0 con 0x7fae2c154480 2020-11-20T11:18:14.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.609+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fae2001b030 con 0x7fae2c154480 2020-11-20T11:18:14.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.609+0000 7fae0bfff700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 0x7fae04082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.609+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fae200a21d0 con 0x7fae2c154480 2020-11-20T11:18:14.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.610+0000 7fae2bfff700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 0x7fae04082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.610+0000 7fae2bfff700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 0x7fae04082b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fae1c006fd0 tx=0x7fae1c008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.613+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fae20045fd0 con 0x7fae2c154480 2020-11-20T11:18:14.751 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.748+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae2c062430 con 0x7fae04080670 2020-11-20T11:18:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.752+0000 7fae0bfff700 1 -- 172.21.15.112:0/2597920384 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99699 (secure 0 0 0) 0x7fae2c062430 con 0x7fae04080670 2020-11-20T11:18:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 msgr2=0x7fae04082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 0x7fae04082b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fae1c006fd0 tx=0x7fae1c008040).stop 2020-11-20T11:18:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 msgr2=0x7fae2c1506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fae20001200 tx=0x7fae2c154d50).stop 2020-11-20T11:18:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 shutdown_connections 2020-11-20T11:18:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fae04080670 0x7fae04082b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae2c0be6d0 0x7fae2c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fae18004e90 0x7fae2c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 --2- 172.21.15.112:0/2597920384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae2c154480 0x7fae2c1506e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 >> 172.21.15.112:0/2597920384 conn(0x7fae2c060820 msgr2=0x7fae2c1531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 shutdown_connections 2020-11-20T11:18:14.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.754+0000 7fae31653700 1 -- 172.21.15.112:0/2597920384 wait complete. 2020-11-20T11:18:14.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:14.761 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:18:14.769 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-11-20T11:18:14.064435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":62016,"kb_used_data":3616,"kb_used_omap":0,"kb_used_meta":58304,"kb_avail":1132400064,"statfs":{"total":1159641169920,"available":1159577665536,"internally_reserved":0,"allocated":3702784,"data_stored":1663980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59703296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.005753"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.984942+0000","last_change":"2020-11-20T11:18:02.984319+0000","last_active":"2020-11-20T11:18:02.984942+0000","last_peered":"2020-11-20T11:18:02.984942+0000","last_clean":"2020-11-20T11:18:02.984942+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:18:02.984942+0000","last_undegraded":"2020-11-20T11:18:02.984942+0000","last_fullsized":"2020-11-20T11:18:02.984942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725498+0000","last_change":"2020-11-20T11:17:56.684598+0000","last_active":"2020-11-20T11:18:02.725498+0000","last_peered":"2020-11-20T11:18:02.725498+0000","last_clean":"2020-11-20T11:18:02.725498+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:18:02.725498+0000","last_undegraded":"2020-11-20T11:18:02.725498+0000","last_fullsized":"2020-11-20T11:18:02.725498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076814+0000","last_change":"2020-11-20T11:17:59.712095+0000","last_active":"2020-11-20T11:18:03.076814+0000","last_peered":"2020-11-20T11:18:03.076814+0000","last_clean":"2020-11-20T11:18:03.076814+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:18:03.076814+0000","last_undegraded":"2020-11-20T11:18:03.076814+0000","last_fullsized":"2020-11-20T11:18:03.076814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985789+0000","last_change":"2020-11-20T11:18:02.983813+0000","last_active":"2020-11-20T11:18:02.985789+0000","last_peered":"2020-11-20T11:18:02.985789+0000","last_clean":"2020-11-20T11:18:02.985789+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:18:02.985789+0000","last_undegraded":"2020-11-20T11:18:02.985789+0000","last_fullsized":"2020-11-20T11:18:02.985789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727156+0000","last_change":"2020-11-20T11:17:56.596872+0000","last_active":"2020-11-20T11:18:02.727156+0000","last_peered":"2020-11-20T11:18:02.727156+0000","last_clean":"2020-11-20T11:18:02.727156+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:18:02.727156+0000","last_undegraded":"2020-11-20T11:18:02.727156+0000","last_fullsized":"2020-11-20T11:18:02.727156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":"16","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.072376+0000","last_change":"2020-11-20T11:18:00.078924+0000","last_active":"2020-11-20T11:18:03.072376+0000","last_peered":"2020-11-20T11:18:03.072376+0000","last_clean":"2020-11-20T11:18:03.072376+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:18:03.072376+0000","last_undegraded":"2020-11-20T11:18:03.072376+0000","last_fullsized":"2020-11-20T11:18:03.072376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985749+0000","last_change":"2020-11-20T11:18:02.983930+0000","last_active":"2020-11-20T11:18:02.985749+0000","last_peered":"2020-11-20T11:18:02.985749+0000","last_clean":"2020-11-20T11:18:02.985749+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:18:02.985749+0000","last_undegraded":"2020-11-20T11:18:02.985749+0000","last_fullsized":"2020-11-20T11:18:02.985749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730426+0000","last_change":"2020-11-20T11:17:56.650092+0000","last_active":"2020-11-20T11:18:02.730426+0000","last_peered":"2020-11-20T11:18:02.730426+0000","last_clean":"2020-11-20T11:18:02.730426+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:18:02.730426+0000","last_undegraded":"2020-11-20T11:18:02.730426+0000","last_fullsized":"2020-11-20T11:18:02.730426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":"19","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076202+0000","last_change":"2020-11-20T11:18:00.079058+0000","last_active":"2020-11-20T11:18:03.076202+0000","last_peered":"2020-11-20T11:18:03.076202+0000","last_clean":"2020-11-20T11:18:03.076202+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:18:03.076202+0000","last_undegraded":"2020-11-20T11:18:03.076202+0000","last_fullsized":"2020-11-20T11:18:03.076202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.739576+0000","last_change":"2020-11-20T11:18:02.735144+0000","last_active":"2020-11-20T11:18:02.739576+0000","last_peered":"2020-11-20T11:18:02.739576+0000","last_clean":"2020-11-20T11:18:02.739576+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:18:02.739576+0000","last_undegraded":"2020-11-20T11:18:02.739576+0000","last_fullsized":"2020-11-20T11:18:02.739576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981614+0000","last_change":"2020-11-20T11:17:56.679644+0000","last_active":"2020-11-20T11:18:02.981614+0000","last_peered":"2020-11-20T11:18:02.981614+0000","last_clean":"2020-11-20T11:18:02.981614+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:18:02.981614+0000","last_undegraded":"2020-11-20T11:18:02.981614+0000","last_fullsized":"2020-11-20T11:18:02.981614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'3","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727126+0000","last_change":"2020-11-20T11:17:52.237351+0000","last_active":"2020-11-20T11:18:02.727126+0000","last_peered":"2020-11-20T11:18:02.727126+0000","last_clean":"2020-11-20T11:18:02.727126+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:18:02.727126+0000","last_undegraded":"2020-11-20T11:18:02.727126+0000","last_fullsized":"2020-11-20T11:18:02.727126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_clean_scrub_stamp":"2020-11-20T11:17:46.208466+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'1","reported_seq":"13","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.059842+0000","last_change":"2020-11-20T11:17:59.712995+0000","last_active":"2020-11-20T11:18:03.059842+0000","last_peered":"2020-11-20T11:18:03.059842+0000","last_clean":"2020-11-20T11:18:03.059842+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:18:03.059842+0000","last_undegraded":"2020-11-20T11:18:03.059842+0000","last_fullsized":"2020-11-20T11:18:03.059842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.988438+0000","last_change":"2020-11-20T11:18:02.984495+0000","last_active":"2020-11-20T11:18:02.988438+0000","last_peered":"2020-11-20T11:18:02.988438+0000","last_clean":"2020-11-20T11:18:02.988438+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:18:02.988438+0000","last_undegraded":"2020-11-20T11:18:02.988438+0000","last_fullsized":"2020-11-20T11:18:02.988438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727158+0000","last_change":"2020-11-20T11:17:56.679955+0000","last_active":"2020-11-20T11:18:02.727158+0000","last_peered":"2020-11-20T11:18:02.727158+0000","last_clean":"2020-11-20T11:18:02.727158+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:18:02.727158+0000","last_undegraded":"2020-11-20T11:18:02.727158+0000","last_fullsized":"2020-11-20T11:18:02.727158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730502+0000","last_change":"2020-11-20T11:18:00.078954+0000","last_active":"2020-11-20T11:18:02.730502+0000","last_peered":"2020-11-20T11:18:02.730502+0000","last_clean":"2020-11-20T11:18:02.730502+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:18:02.730502+0000","last_undegraded":"2020-11-20T11:18:02.730502+0000","last_fullsized":"2020-11-20T11:18:02.730502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.736240+0000","last_change":"2020-11-20T11:18:02.735416+0000","last_active":"2020-11-20T11:18:02.736240+0000","last_peered":"2020-11-20T11:18:02.736240+0000","last_clean":"2020-11-20T11:18:02.736240+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:18:02.736240+0000","last_undegraded":"2020-11-20T11:18:02.736240+0000","last_fullsized":"2020-11-20T11:18:02.736240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.728849+0000","last_change":"2020-11-20T11:17:56.678488+0000","last_active":"2020-11-20T11:18:02.728849+0000","last_peered":"2020-11-20T11:18:02.728849+0000","last_clean":"2020-11-20T11:18:02.728849+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:18:02.728849+0000","last_undegraded":"2020-11-20T11:18:02.728849+0000","last_fullsized":"2020-11-20T11:18:02.728849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'8","reported_seq":"19","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076560+0000","last_change":"2020-11-20T11:18:00.078835+0000","last_active":"2020-11-20T11:18:03.076560+0000","last_peered":"2020-11-20T11:18:03.076560+0000","last_clean":"2020-11-20T11:18:03.076560+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:18:03.076560+0000","last_undegraded":"2020-11-20T11:18:03.076560+0000","last_fullsized":"2020-11-20T11:18:03.076560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.987827+0000","last_change":"2020-11-20T11:18:02.984543+0000","last_active":"2020-11-20T11:18:02.987827+0000","last_peered":"2020-11-20T11:18:02.987827+0000","last_clean":"2020-11-20T11:18:02.987827+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:18:02.987827+0000","last_undegraded":"2020-11-20T11:18:02.987827+0000","last_fullsized":"2020-11-20T11:18:02.987827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.074029+0000","last_change":"2020-11-20T11:18:00.078852+0000","last_active":"2020-11-20T11:18:03.074029+0000","last_peered":"2020-11-20T11:18:03.074029+0000","last_clean":"2020-11-20T11:18:03.074029+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:18:03.074029+0000","last_undegraded":"2020-11-20T11:18:03.074029+0000","last_fullsized":"2020-11-20T11:18:03.074029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725499+0000","last_change":"2020-11-20T11:17:56.594357+0000","last_active":"2020-11-20T11:18:02.725499+0000","last_peered":"2020-11-20T11:18:02.725499+0000","last_clean":"2020-11-20T11:18:02.725499+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:18:02.725499+0000","last_undegraded":"2020-11-20T11:18:02.725499+0000","last_fullsized":"2020-11-20T11:18:02.725499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985957+0000","last_change":"2020-11-20T11:18:02.984521+0000","last_active":"2020-11-20T11:18:02.985957+0000","last_peered":"2020-11-20T11:18:02.985957+0000","last_clean":"2020-11-20T11:18:02.985957+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:18:02.985957+0000","last_undegraded":"2020-11-20T11:18:02.985957+0000","last_fullsized":"2020-11-20T11:18:02.985957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981711+0000","last_change":"2020-11-20T11:17:56.681946+0000","last_active":"2020-11-20T11:18:02.981711+0000","last_peered":"2020-11-20T11:18:02.981711+0000","last_clean":"2020-11-20T11:18:02.981711+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:18:02.981711+0000","last_undegraded":"2020-11-20T11:18:02.981711+0000","last_fullsized":"2020-11-20T11:18:02.981711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'4","reported_seq":"15","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076271+0000","last_change":"2020-11-20T11:17:59.712094+0000","last_active":"2020-11-20T11:18:03.076271+0000","last_peered":"2020-11-20T11:18:03.076271+0000","last_clean":"2020-11-20T11:18:03.076271+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:18:03.076271+0000","last_undegraded":"2020-11-20T11:18:03.076271+0000","last_fullsized":"2020-11-20T11:18:03.076271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411335,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":7,"up_from":18,"seq":77309411335,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":1,"up_from":18,"seq":77309411334,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5104,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366736,"statfs":{"total":96636764160,"available":96631537664,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]}]},{"osd":11,"up_from":18,"seq":77309411335,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5176,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366664,"statfs":{"total":96636764160,"available":96631463936,"internally_reserved":0,"allocated":311296,"data_stored":138856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]}]},{"osd":10,"up_from":18,"seq":77309411335,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":138475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.708}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]}]},{"osd":9,"up_from":18,"seq":77309411334,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411334,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]}]},{"osd":0,"up_from":18,"seq":77309411334,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.675}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8169999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":3,"up_from":18,"seq":77309411334,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5184,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366656,"statfs":{"total":96636764160,"available":96631455744,"internally_reserved":0,"allocated":319488,"data_stored":139016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]}]},{"osd":4,"up_from":18,"seq":77309411335,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":138315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]}]},{"osd":5,"up_from":18,"seq":77309411335,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":6,"up_from":18,"seq":77309411334,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]}]}]}} 2020-11-20T11:18:14.805 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:18:14.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.912+0000 7f6be7591700 1 Processor -- start 2020-11-20T11:18:14.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.912+0000 7f6be7591700 1 -- start start 2020-11-20T11:18:14.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6be7591700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be00c5230 con 0x7f6be01519f0 2020-11-20T11:18:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6be7591700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be01549c0 con 0x7f6be0065d30 2020-11-20T11:18:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6be7591700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be0154c60 con 0x7f6be0066110 2020-11-20T11:18:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6be5b2e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6be01519f0 0x7f6be015be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35306/0 (socket says 172.21.15.112:35306) 2020-11-20T11:18:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6be5b2e700 1 -- 172.21.15.112:0/10002086 learned_addr learned my addr 172.21.15.112:0/10002086 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681065211 0 0) 0x7f6be00c5230 con 0x7f6be01519f0 2020-11-20T11:18:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc8003280 con 0x7f6be01519f0 2020-11-20T11:18:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1981556559 0 0) 0x7f6bc8003280 con 0x7f6be01519f0 2020-11-20T11:18:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 >> v1:172.21.15.204:6789/0 conn(0x7f6be0066110 legacy=0x7f6be01512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 >> v1:172.21.15.166:6789/0 conn(0x7f6be0065d30 legacy=0x7f6be00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0154f00 con 0x7f6be01519f0 2020-11-20T11:18:14.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f6bd80018a0 con 0x7f6be01519f0 2020-11-20T11:18:14.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 >> v1:172.21.15.112:6789/0 conn(0x7f6be01519f0 legacy=0x7f6be015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.913+0000 7f6bcffff700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc80037f0 0x7f6bc8003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 0x7f6bc80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6bc8004e90 0x7f6bc800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8005370 con 0x7f6bc8004520 2020-11-20T11:18:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc800bc60 con 0x7f6bc8004e90 2020-11-20T11:18:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc800bdd0 con 0x7f6bc80037f0 2020-11-20T11:18:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 0x7f6bc80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be532d700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc80037f0 0x7f6bc8003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be5b2e700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6bc8004e90 0x7f6bc800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 -- 172.21.15.112:0/10002086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc80037f0 msgr2=0x7f6bc8003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc80037f0 0x7f6bc8003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 -- 172.21.15.112:0/10002086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6bc8004e90 msgr2=0x7f6bc800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6bc8004e90 0x7f6bc800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be5b2e700 1 -- 172.21.15.112:0/10002086 reap_dead start 2020-11-20T11:18:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 -- 172.21.15.112:0/10002086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8003280 con 0x7f6bc8004520 2020-11-20T11:18:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 0x7f6bc80049a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f6bdc001960 tx=0x7f6bdc007bd0).ready entity=mon.0 client_cookie=33b1248916e762ec server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc007020 con 0x7f6bc8004520 2020-11-20T11:18:14.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc007180 con 0x7f6bc8004520 2020-11-20T11:18:14.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.914+0000 7f6bcffff700 1 -- 172.21.15.112:0/10002086 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00c860 con 0x7f6bc8004520 2020-11-20T11:18:14.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 -- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 msgr2=0x7f6bc80049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 0x7f6bc80049a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f6bdc001960 tx=0x7f6bdc007bd0).stop 2020-11-20T11:18:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 -- 172.21.15.112:0/10002086 shutdown_connections 2020-11-20T11:18:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 --2- 172.21.15.112:0/10002086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc8004520 0x7f6bc80049a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 -- 172.21.15.112:0/10002086 >> 172.21.15.112:0/10002086 conn(0x7f6be005bac0 msgr2=0x7f6be005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 -- 172.21.15.112:0/10002086 shutdown_connections 2020-11-20T11:18:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.915+0000 7f6be7591700 1 -- 172.21.15.112:0/10002086 wait complete. 2020-11-20T11:18:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.916+0000 7f6be7591700 1 Processor -- start 2020-11-20T11:18:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.916+0000 7f6be7591700 1 -- start start 2020-11-20T11:18:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 0x7f6be0153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 0x7f6be0160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0161030 con 0x7f6be014b4b0 2020-11-20T11:18:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01612d0 con 0x7f6be0157a90 2020-11-20T11:18:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0161570 con 0x7f6bc8004520 2020-11-20T11:18:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51122/0 (socket says 172.21.15.112:51122) 2020-11-20T11:18:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 -- 172.21.15.112:0/1891977122 learned_addr learned my addr 172.21.15.112:0/1891977122 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be5b2e700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 0x7f6be0160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be532d700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 0x7f6be0153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 -- 172.21.15.112:0/1891977122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 msgr2=0x7f6be0153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 0x7f6be0153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 -- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 msgr2=0x7f6be0160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 0x7f6be0160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 -- 172.21.15.112:0/1891977122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0153290 con 0x7f6be014b4b0 2020-11-20T11:18:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be5b2e700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 0x7f6be0160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be532d700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 0x7f6be0153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be4b2c700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bc80054b0 tx=0x7f6bdc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc007500 con 0x7f6be014b4b0 2020-11-20T11:18:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc013aa0 con 0x7f6be014b4b0 2020-11-20T11:18:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc013e40 con 0x7f6be014b4b0 2020-11-20T11:18:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be0153530 con 0x7f6be014b4b0 2020-11-20T11:18:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.917+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be0154160 con 0x7f6be014b4b0 2020-11-20T11:18:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.918+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be0153990 con 0x7f6be014b4b0 2020-11-20T11:18:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.919+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6bdc026020 con 0x7f6be014b4b0 2020-11-20T11:18:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.919+0000 7f6bcd7fa700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 0x7f6bb8082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.919+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6bdc0a3f70 con 0x7f6be014b4b0 2020-11-20T11:18:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.920+0000 7f6be532d700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 0x7f6bb8082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.920+0000 7f6be532d700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 0x7f6bb8082b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6bd00079b0 tx=0x7f6bd0009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:14.923+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6bdc078900 con 0x7f6be014b4b0 2020-11-20T11:18:15.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.059+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6be0161030 con 0x7f6bb80806a0 2020-11-20T11:18:15.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.063+0000 7f6bcd7fa700 1 -- 172.21.15.112:0/1891977122 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99699 (secure 0 0 0) 0x7f6be0161030 con 0x7f6bb80806a0 2020-11-20T11:18:15.067 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:15.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 msgr2=0x7f6bb8082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 0x7f6bb8082b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6bd00079b0 tx=0x7f6bd0009040).stop 2020-11-20T11:18:15.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 msgr2=0x7f6be00c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bc80054b0 tx=0x7f6bdc015000).stop 2020-11-20T11:18:15.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 shutdown_connections 2020-11-20T11:18:15.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6bb80806a0 0x7f6bb8082b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6be0157a90 0x7f6be0160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc8004520 0x7f6be0153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 --2- 172.21.15.112:0/1891977122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6be014b4b0 0x7f6be00c81a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 >> 172.21.15.112:0/1891977122 conn(0x7f6be005bac0 msgr2=0x7f6be01512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 shutdown_connections 2020-11-20T11:18:15.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.065+0000 7f6be7591700 1 -- 172.21.15.112:0/1891977122 wait complete. 2020-11-20T11:18:15.071 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:18:15.078 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-11-20T11:18:14.064435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":62016,"kb_used_data":3616,"kb_used_omap":0,"kb_used_meta":58304,"kb_avail":1132400064,"statfs":{"total":1159641169920,"available":1159577665536,"internally_reserved":0,"allocated":3702784,"data_stored":1663980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59703296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.005753"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.984942+0000","last_change":"2020-11-20T11:18:02.984319+0000","last_active":"2020-11-20T11:18:02.984942+0000","last_peered":"2020-11-20T11:18:02.984942+0000","last_clean":"2020-11-20T11:18:02.984942+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:18:02.984942+0000","last_undegraded":"2020-11-20T11:18:02.984942+0000","last_fullsized":"2020-11-20T11:18:02.984942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725498+0000","last_change":"2020-11-20T11:17:56.684598+0000","last_active":"2020-11-20T11:18:02.725498+0000","last_peered":"2020-11-20T11:18:02.725498+0000","last_clean":"2020-11-20T11:18:02.725498+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:18:02.725498+0000","last_undegraded":"2020-11-20T11:18:02.725498+0000","last_fullsized":"2020-11-20T11:18:02.725498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'6","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076814+0000","last_change":"2020-11-20T11:17:59.712095+0000","last_active":"2020-11-20T11:18:03.076814+0000","last_peered":"2020-11-20T11:18:03.076814+0000","last_clean":"2020-11-20T11:18:03.076814+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:18:03.076814+0000","last_undegraded":"2020-11-20T11:18:03.076814+0000","last_fullsized":"2020-11-20T11:18:03.076814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985789+0000","last_change":"2020-11-20T11:18:02.983813+0000","last_active":"2020-11-20T11:18:02.985789+0000","last_peered":"2020-11-20T11:18:02.985789+0000","last_clean":"2020-11-20T11:18:02.985789+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:18:02.985789+0000","last_undegraded":"2020-11-20T11:18:02.985789+0000","last_fullsized":"2020-11-20T11:18:02.985789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727156+0000","last_change":"2020-11-20T11:17:56.596872+0000","last_active":"2020-11-20T11:18:02.727156+0000","last_peered":"2020-11-20T11:18:02.727156+0000","last_clean":"2020-11-20T11:18:02.727156+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:18:02.727156+0000","last_undegraded":"2020-11-20T11:18:02.727156+0000","last_fullsized":"2020-11-20T11:18:02.727156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'5","reported_seq":"16","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.072376+0000","last_change":"2020-11-20T11:18:00.078924+0000","last_active":"2020-11-20T11:18:03.072376+0000","last_peered":"2020-11-20T11:18:03.072376+0000","last_clean":"2020-11-20T11:18:03.072376+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:18:03.072376+0000","last_undegraded":"2020-11-20T11:18:03.072376+0000","last_fullsized":"2020-11-20T11:18:03.072376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985749+0000","last_change":"2020-11-20T11:18:02.983930+0000","last_active":"2020-11-20T11:18:02.985749+0000","last_peered":"2020-11-20T11:18:02.985749+0000","last_clean":"2020-11-20T11:18:02.985749+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:18:02.985749+0000","last_undegraded":"2020-11-20T11:18:02.985749+0000","last_fullsized":"2020-11-20T11:18:02.985749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730426+0000","last_change":"2020-11-20T11:17:56.650092+0000","last_active":"2020-11-20T11:18:02.730426+0000","last_peered":"2020-11-20T11:18:02.730426+0000","last_clean":"2020-11-20T11:18:02.730426+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:18:02.730426+0000","last_undegraded":"2020-11-20T11:18:02.730426+0000","last_fullsized":"2020-11-20T11:18:02.730426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":"19","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076202+0000","last_change":"2020-11-20T11:18:00.079058+0000","last_active":"2020-11-20T11:18:03.076202+0000","last_peered":"2020-11-20T11:18:03.076202+0000","last_clean":"2020-11-20T11:18:03.076202+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:18:03.076202+0000","last_undegraded":"2020-11-20T11:18:03.076202+0000","last_fullsized":"2020-11-20T11:18:03.076202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.739576+0000","last_change":"2020-11-20T11:18:02.735144+0000","last_active":"2020-11-20T11:18:02.739576+0000","last_peered":"2020-11-20T11:18:02.739576+0000","last_clean":"2020-11-20T11:18:02.739576+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:18:02.739576+0000","last_undegraded":"2020-11-20T11:18:02.739576+0000","last_fullsized":"2020-11-20T11:18:02.739576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981614+0000","last_change":"2020-11-20T11:17:56.679644+0000","last_active":"2020-11-20T11:18:02.981614+0000","last_peered":"2020-11-20T11:18:02.981614+0000","last_clean":"2020-11-20T11:18:02.981614+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:18:02.981614+0000","last_undegraded":"2020-11-20T11:18:02.981614+0000","last_fullsized":"2020-11-20T11:18:02.981614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'3","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727126+0000","last_change":"2020-11-20T11:17:52.237351+0000","last_active":"2020-11-20T11:18:02.727126+0000","last_peered":"2020-11-20T11:18:02.727126+0000","last_clean":"2020-11-20T11:18:02.727126+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:18:02.727126+0000","last_undegraded":"2020-11-20T11:18:02.727126+0000","last_fullsized":"2020-11-20T11:18:02.727126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_clean_scrub_stamp":"2020-11-20T11:17:46.208466+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'1","reported_seq":"13","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.059842+0000","last_change":"2020-11-20T11:17:59.712995+0000","last_active":"2020-11-20T11:18:03.059842+0000","last_peered":"2020-11-20T11:18:03.059842+0000","last_clean":"2020-11-20T11:18:03.059842+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:18:03.059842+0000","last_undegraded":"2020-11-20T11:18:03.059842+0000","last_fullsized":"2020-11-20T11:18:03.059842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.988438+0000","last_change":"2020-11-20T11:18:02.984495+0000","last_active":"2020-11-20T11:18:02.988438+0000","last_peered":"2020-11-20T11:18:02.988438+0000","last_clean":"2020-11-20T11:18:02.988438+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:18:02.988438+0000","last_undegraded":"2020-11-20T11:18:02.988438+0000","last_fullsized":"2020-11-20T11:18:02.988438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727158+0000","last_change":"2020-11-20T11:17:56.679955+0000","last_active":"2020-11-20T11:18:02.727158+0000","last_peered":"2020-11-20T11:18:02.727158+0000","last_clean":"2020-11-20T11:18:02.727158+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:18:02.727158+0000","last_undegraded":"2020-11-20T11:18:02.727158+0000","last_fullsized":"2020-11-20T11:18:02.727158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730502+0000","last_change":"2020-11-20T11:18:00.078954+0000","last_active":"2020-11-20T11:18:02.730502+0000","last_peered":"2020-11-20T11:18:02.730502+0000","last_clean":"2020-11-20T11:18:02.730502+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:18:02.730502+0000","last_undegraded":"2020-11-20T11:18:02.730502+0000","last_fullsized":"2020-11-20T11:18:02.730502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.736240+0000","last_change":"2020-11-20T11:18:02.735416+0000","last_active":"2020-11-20T11:18:02.736240+0000","last_peered":"2020-11-20T11:18:02.736240+0000","last_clean":"2020-11-20T11:18:02.736240+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:18:02.736240+0000","last_undegraded":"2020-11-20T11:18:02.736240+0000","last_fullsized":"2020-11-20T11:18:02.736240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.728849+0000","last_change":"2020-11-20T11:17:56.678488+0000","last_active":"2020-11-20T11:18:02.728849+0000","last_peered":"2020-11-20T11:18:02.728849+0000","last_clean":"2020-11-20T11:18:02.728849+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:18:02.728849+0000","last_undegraded":"2020-11-20T11:18:02.728849+0000","last_fullsized":"2020-11-20T11:18:02.728849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'8","reported_seq":"19","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076560+0000","last_change":"2020-11-20T11:18:00.078835+0000","last_active":"2020-11-20T11:18:03.076560+0000","last_peered":"2020-11-20T11:18:03.076560+0000","last_clean":"2020-11-20T11:18:03.076560+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:18:03.076560+0000","last_undegraded":"2020-11-20T11:18:03.076560+0000","last_fullsized":"2020-11-20T11:18:03.076560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.987827+0000","last_change":"2020-11-20T11:18:02.984543+0000","last_active":"2020-11-20T11:18:02.987827+0000","last_peered":"2020-11-20T11:18:02.987827+0000","last_clean":"2020-11-20T11:18:02.987827+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:18:02.987827+0000","last_undegraded":"2020-11-20T11:18:02.987827+0000","last_fullsized":"2020-11-20T11:18:02.987827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.074029+0000","last_change":"2020-11-20T11:18:00.078852+0000","last_active":"2020-11-20T11:18:03.074029+0000","last_peered":"2020-11-20T11:18:03.074029+0000","last_clean":"2020-11-20T11:18:03.074029+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:18:03.074029+0000","last_undegraded":"2020-11-20T11:18:03.074029+0000","last_fullsized":"2020-11-20T11:18:03.074029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725499+0000","last_change":"2020-11-20T11:17:56.594357+0000","last_active":"2020-11-20T11:18:02.725499+0000","last_peered":"2020-11-20T11:18:02.725499+0000","last_clean":"2020-11-20T11:18:02.725499+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:18:02.725499+0000","last_undegraded":"2020-11-20T11:18:02.725499+0000","last_fullsized":"2020-11-20T11:18:02.725499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.985957+0000","last_change":"2020-11-20T11:18:02.984521+0000","last_active":"2020-11-20T11:18:02.985957+0000","last_peered":"2020-11-20T11:18:02.985957+0000","last_clean":"2020-11-20T11:18:02.985957+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:18:02.985957+0000","last_undegraded":"2020-11-20T11:18:02.985957+0000","last_fullsized":"2020-11-20T11:18:02.985957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981711+0000","last_change":"2020-11-20T11:17:56.681946+0000","last_active":"2020-11-20T11:18:02.981711+0000","last_peered":"2020-11-20T11:18:02.981711+0000","last_clean":"2020-11-20T11:18:02.981711+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:18:02.981711+0000","last_undegraded":"2020-11-20T11:18:02.981711+0000","last_fullsized":"2020-11-20T11:18:02.981711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'4","reported_seq":"15","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:18:03.076271+0000","last_change":"2020-11-20T11:17:59.712094+0000","last_active":"2020-11-20T11:18:03.076271+0000","last_peered":"2020-11-20T11:18:03.076271+0000","last_clean":"2020-11-20T11:18:03.076271+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:18:03.076271+0000","last_undegraded":"2020-11-20T11:18:03.076271+0000","last_fullsized":"2020-11-20T11:18:03.076271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411335,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":7,"up_from":18,"seq":77309411335,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":1,"up_from":18,"seq":77309411334,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5104,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366736,"statfs":{"total":96636764160,"available":96631537664,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]}]},{"osd":11,"up_from":18,"seq":77309411335,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5176,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366664,"statfs":{"total":96636764160,"available":96631463936,"internally_reserved":0,"allocated":311296,"data_stored":138856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]}]},{"osd":10,"up_from":18,"seq":77309411335,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":138475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.708}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]}]},{"osd":9,"up_from":18,"seq":77309411334,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411334,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]}]},{"osd":0,"up_from":18,"seq":77309411334,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.675}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8169999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":3,"up_from":18,"seq":77309411334,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5184,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366656,"statfs":{"total":96636764160,"available":96631455744,"internally_reserved":0,"allocated":319488,"data_stored":139016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]}]},{"osd":4,"up_from":18,"seq":77309411335,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":138315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]}]},{"osd":5,"up_from":18,"seq":77309411335,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":6,"up_from":18,"seq":77309411334,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]}]}]}} 2020-11-20T11:18:15.081 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T11:18:15.082 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T11:18:15.082 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T11:18:15.082 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T11:18:15.190 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.188+0000 7fde1db4f700 1 Processor -- start 2020-11-20T11:18:15.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.188+0000 7fde1db4f700 1 -- start start 2020-11-20T11:18:15.192 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.188+0000 7fde1db4f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde180c3fc0 0x7fde181514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.188+0000 7fde1db4f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180c0300 con 0x7fde180c3be0 2020-11-20T11:18:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.188+0000 7fde1db4f700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde18151a90 con 0x7fde180c0a30 2020-11-20T11:18:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde1db4f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde18151d30 con 0x7fde180c3fc0 2020-11-20T11:18:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde180c3fc0 0x7fde181514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde180c3fc0 0x7fde181514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51128/0 (socket says 172.21.15.112:51128) 2020-11-20T11:18:15.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 -- 172.21.15.112:0/3411416304 learned_addr learned my addr 172.21.15.112:0/3411416304 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:15.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 -- 172.21.15.112:0/3411416304 >> v1:172.21.15.204:6789/0 conn(0x7fde180c0a30 legacy=0x7fde1814e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 -- 172.21.15.112:0/3411416304 >> v1:172.21.15.166:6789/0 conn(0x7fde180c3be0 legacy=0x7fde180bb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 -- 172.21.15.112:0/3411416304 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18151fd0 con 0x7fde180c3fc0 2020-11-20T11:18:15.194 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde16ffd700 1 --2- 172.21.15.112:0/3411416304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c3fc0 0x7fde181514b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fde0c009a10 tx=0x7fde0c006ef0).ready entity=mon.0 client_cookie=c0d512dcc640daa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde167fc700 1 -- 172.21.15.112:0/3411416304 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00b860 con 0x7fde180c3fc0 2020-11-20T11:18:15.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde167fc700 1 -- 172.21.15.112:0/3411416304 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c000e90 con 0x7fde180c3fc0 2020-11-20T11:18:15.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.189+0000 7fde167fc700 1 -- 172.21.15.112:0/3411416304 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00bbd0 con 0x7fde180c3fc0 2020-11-20T11:18:15.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 -- 172.21.15.112:0/3411416304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c3fc0 msgr2=0x7fde181514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.195 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 --2- 172.21.15.112:0/3411416304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c3fc0 0x7fde181514b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fde0c009a10 tx=0x7fde0c006ef0).stop 2020-11-20T11:18:15.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 -- 172.21.15.112:0/3411416304 shutdown_connections 2020-11-20T11:18:15.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 --2- 172.21.15.112:0/3411416304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c3fc0 0x7fde181514b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 -- 172.21.15.112:0/3411416304 >> 172.21.15.112:0/3411416304 conn(0x7fde1805bac0 msgr2=0x7fde18062f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 -- 172.21.15.112:0/3411416304 shutdown_connections 2020-11-20T11:18:15.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.190+0000 7fde1db4f700 1 -- 172.21.15.112:0/3411416304 wait complete. 2020-11-20T11:18:15.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.191+0000 7fde1db4f700 1 Processor -- start 2020-11-20T11:18:15.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.191+0000 7fde1db4f700 1 -- start start 2020-11-20T11:18:15.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 0x7fde180bee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde180c3fc0 0x7fde181611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde181501c0 con 0x7fde180c0a30 2020-11-20T11:18:15.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde180bf330 con 0x7fde180c3be0 2020-11-20T11:18:15.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde181503b0 con 0x7fde180c3fc0 2020-11-20T11:18:15.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51134/0 (socket says 172.21.15.112:51134) 2020-11-20T11:18:15.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 -- 172.21.15.112:0/2654444768 learned_addr learned my addr 172.21.15.112:0/2654444768 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:15.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde16ffd700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 0x7fde180bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 -- 172.21.15.112:0/2654444768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde180c3fc0 msgr2=0x7fde181611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde180c3fc0 0x7fde181611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:15.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 -- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 msgr2=0x7fde180bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 0x7fde180bee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 -- 172.21.15.112:0/2654444768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18150650 con 0x7fde180c0a30 2020-11-20T11:18:15.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde16ffd700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 0x7fde180bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:15.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde177fe700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fde0800c710 tx=0x7fde08007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08007020 con 0x7fde180c0a30 2020-11-20T11:18:15.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08001e90 con 0x7fde180c0a30 2020-11-20T11:18:15.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde181508f0 con 0x7fde180c0a30 2020-11-20T11:18:15.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde080073b0 con 0x7fde180c0a30 2020-11-20T11:18:15.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.192+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18160d30 con 0x7fde180c0a30 2020-11-20T11:18:15.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.194+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde181608d0 con 0x7fde180c0a30 2020-11-20T11:18:15.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.194+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fde08010070 con 0x7fde180c0a30 2020-11-20T11:18:15.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.194+0000 7fddf77fe700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 0x7fddf0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.194+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fde080a1df0 con 0x7fde180c0a30 2020-11-20T11:18:15.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.195+0000 7fde16ffd700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 0x7fddf0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.195+0000 7fde16ffd700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 0x7fddf0082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fde0c006f30 tx=0x7fde0c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.198+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fde08076800 con 0x7fde180c0a30 2020-11-20T11:18:15.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.388+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde18150a80 con 0x7fde180c0a30 2020-11-20T11:18:15.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.388+0000 7fddf77fe700 1 -- 172.21.15.112:0/2654444768 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fde08079e20 con 0x7fde180c0a30 2020-11-20T11:18:15.392 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.389+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 msgr2=0x7fddf0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.389+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 0x7fddf0082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fde0c006f30 tx=0x7fde0c015000).stop 2020-11-20T11:18:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 msgr2=0x7fde18161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fde0800c710 tx=0x7fde08007c90).stop 2020-11-20T11:18:15.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 shutdown_connections 2020-11-20T11:18:15.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fddf0080670 0x7fddf0082b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde180c3fc0 0x7fde181611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:15.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde180c0a30 0x7fde18161d30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 --2- 172.21.15.112:0/2654444768 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fde180c3be0 0x7fde180bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 >> 172.21.15.112:0/2654444768 conn(0x7fde1805bac0 msgr2=0x7fde180c1990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 shutdown_connections 2020-11-20T11:18:15.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.390+0000 7fde1db4f700 1 -- 172.21.15.112:0/2654444768 wait complete. 2020-11-20T11:18:15.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T11:18:15.404 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T11:18:15.404 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:15.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.510+0000 7f06f34b3700 1 Processor -- start 2020-11-20T11:18:15.513 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.510+0000 7f06f34b3700 1 -- start start 2020-11-20T11:18:15.520 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f34b3700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f06ec14ea20 0x7f06ec0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.520 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f34b3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec14eeb0 con 0x7f06ec064df0 2020-11-20T11:18:15.520 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f34b3700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0c4b60 con 0x7f06ec064a10 2020-11-20T11:18:15.521 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f34b3700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0c02b0 con 0x7f06ec14ea20 2020-11-20T11:18:15.521 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f1cb0700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f06ec064df0 0x7f06ec14e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:45990/0 (socket says 172.21.15.112:45990) 2020-11-20T11:18:15.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f1cb0700 1 -- 172.21.15.112:0/1544140853 learned_addr learned my addr 172.21.15.112:0/1544140853 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:15.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f2cb2700 1 --2- 172.21.15.112:0/1544140853 >> v2:172.21.15.204:3300/0 conn(0x7f06ec14ea20 0x7f06ec0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.522 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f14af700 1 -- 172.21.15.112:0/1544140853 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077966818 0 0) 0x7f06ec14eeb0 con 0x7f06ec064df0 2020-11-20T11:18:15.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f14af700 1 -- 172.21.15.112:0/1544140853 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d4003280 con 0x7f06ec064df0 2020-11-20T11:18:15.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f2cb2700 1 -- 172.21.15.112:0/1544140853 >> v1:172.21.15.204:6789/0 conn(0x7f06ec064a10 legacy=0x7f06ec0bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f2cb2700 1 -- 172.21.15.112:0/1544140853 >> v1:172.21.15.166:6789/0 conn(0x7f06ec064df0 legacy=0x7f06ec14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.511+0000 7f06f2cb2700 1 -- 172.21.15.112:0/1544140853 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec154bc0 con 0x7f06ec14ea20 2020-11-20T11:18:15.524 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f2cb2700 1 --2- 172.21.15.112:0/1544140853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c4670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f06e4009cc0 tx=0x7f06e4009220).ready entity=mon.2 client_cookie=df11493d537d1994 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f14af700 1 -- 172.21.15.112:0/1544140853 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4005ae0 con 0x7f06ec14ea20 2020-11-20T11:18:15.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f14af700 1 -- 172.21.15.112:0/1544140853 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4005c40 con 0x7f06ec14ea20 2020-11-20T11:18:15.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f14af700 1 -- 172.21.15.112:0/1544140853 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400ba10 con 0x7f06ec14ea20 2020-11-20T11:18:15.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 -- 172.21.15.112:0/1544140853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec14ea20 msgr2=0x7f06ec0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 --2- 172.21.15.112:0/1544140853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c4670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f06e4009cc0 tx=0x7f06e4009220).stop 2020-11-20T11:18:15.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 -- 172.21.15.112:0/1544140853 shutdown_connections 2020-11-20T11:18:15.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 --2- 172.21.15.112:0/1544140853 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c4670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 -- 172.21.15.112:0/1544140853 >> 172.21.15.112:0/1544140853 conn(0x7f06ec060820 msgr2=0x7f06ec05bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 -- 172.21.15.112:0/1544140853 shutdown_connections 2020-11-20T11:18:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.512+0000 7f06f34b3700 1 -- 172.21.15.112:0/1544140853 wait complete. 2020-11-20T11:18:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.513+0000 7f06f34b3700 1 Processor -- start 2020-11-20T11:18:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.513+0000 7f06f34b3700 1 -- start start 2020-11-20T11:18:15.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec064a10 0x7f06ec1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06ec064df0 0x7f06ec164340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1603c0 con 0x7f06ec14ea20 2020-11-20T11:18:15.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec153ee0 con 0x7f06ec064df0 2020-11-20T11:18:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f34b3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec164830 con 0x7f06ec064a10 2020-11-20T11:18:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51152/0 (socket says 172.21.15.112:51152) 2020-11-20T11:18:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 -- 172.21.15.112:0/2650784665 learned_addr learned my addr 172.21.15.112:0/2650784665 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f1cb0700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06ec064df0 0x7f06ec164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f24b1700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec064a10 0x7f06ec1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 -- 172.21.15.112:0/2650784665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec064a10 msgr2=0x7f06ec1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec064a10 0x7f06ec1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 -- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06ec064df0 msgr2=0x7f06ec164340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06ec064df0 0x7f06ec164340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.514+0000 7f06f2cb2700 1 -- 172.21.15.112:0/2650784665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec154120 con 0x7f06ec14ea20 2020-11-20T11:18:15.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06f2cb2700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f06ec061270 tx=0x7f06e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4006870 con 0x7f06ec14ea20 2020-11-20T11:18:15.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e40069d0 con 0x7f06ec14ea20 2020-11-20T11:18:15.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e401d670 con 0x7f06ec14ea20 2020-11-20T11:18:15.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec1605e0 con 0x7f06ec14ea20 2020-11-20T11:18:15.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.515+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec160b20 con 0x7f06ec14ea20 2020-11-20T11:18:15.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.516+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec0008d0 con 0x7f06ec14ea20 2020-11-20T11:18:15.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.516+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f06e4024030 con 0x7f06ec14ea20 2020-11-20T11:18:15.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.517+0000 7f06da7fc700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 0x7f06c4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.517+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f06e40a4530 con 0x7f06ec14ea20 2020-11-20T11:18:15.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.517+0000 7f06f24b1700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 0x7f06c4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.517+0000 7f06f24b1700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 0x7f06c4082b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f06e8003590 tx=0x7f06e8009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.520+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f06e4078ec0 con 0x7f06ec14ea20 2020-11-20T11:18:15.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.658+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ec0612a0 con 0x7f06ec14ea20 2020-11-20T11:18:15.662 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.659+0000 7f06da7fc700 1 -- 172.21.15.112:0/2650784665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f06e4022070 con 0x7f06ec14ea20 2020-11-20T11:18:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:15.663 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:15.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 msgr2=0x7f06c4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 0x7f06c4082b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f06e8003590 tx=0x7f06e8009040).stop 2020-11-20T11:18:15.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 msgr2=0x7f06ec0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f06ec061270 tx=0x7f06e4015000).stop 2020-11-20T11:18:15.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 shutdown_connections 2020-11-20T11:18:15.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06c4080670 0x7f06c4082b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec14ea20 0x7f06ec0c7a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06ec064a10 0x7f06ec1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 --2- 172.21.15.112:0/2650784665 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06ec064df0 0x7f06ec164340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 >> 172.21.15.112:0/2650784665 conn(0x7f06ec060820 msgr2=0x7f06ec0c2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 shutdown_connections 2020-11-20T11:18:15.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.661+0000 7f06f34b3700 1 -- 172.21.15.112:0/2650784665 wait complete. 2020-11-20T11:18:15.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:17:46.086314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:17:55.502772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:17:58.012089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:18:00.733600+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:18:15.676 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:18:15.789 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.786+0000 7fbb567cb700 1 Processor -- start 2020-11-20T11:18:15.789 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.786+0000 7fbb567cb700 1 -- start start 2020-11-20T11:18:15.792 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb567cb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb500c5230 con 0x7fbb50065d30 2020-11-20T11:18:15.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb567cb700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb501549c0 con 0x7fbb501519f0 2020-11-20T11:18:15.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb567cb700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb50154c60 con 0x7fbb50066110 2020-11-20T11:18:15.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb4ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbb50065d30 0x7fbb500c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35350/0 (socket says 172.21.15.112:35350) 2020-11-20T11:18:15.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb4ffff700 1 -- 172.21.15.112:0/2199782542 learned_addr learned my addr 172.21.15.112:0/2199782542 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:15.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090940711 0 0) 0x7fbb500c5230 con 0x7fbb50065d30 2020-11-20T11:18:15.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.787+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3c003280 con 0x7fbb50065d30 2020-11-20T11:18:15.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4216749490 0 0) 0x7fbb3c003280 con 0x7fbb50065d30 2020-11-20T11:18:15.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 >> v1:172.21.15.204:6789/0 conn(0x7fbb50066110 legacy=0x7fbb501512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 >> v1:172.21.15.166:6789/0 conn(0x7fbb501519f0 legacy=0x7fbb5015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50154f00 con 0x7fbb50065d30 2020-11-20T11:18:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fbb40001520 con 0x7fbb50065d30 2020-11-20T11:18:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 >> v1:172.21.15.112:6789/0 conn(0x7fbb50065d30 legacy=0x7fbb500c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb3c003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb3c004520 0x7fbb3c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb3c004e90 0x7fbb3c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c005370 con 0x7fbb3c0037f0 2020-11-20T11:18:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c00bc60 con 0x7fbb3c004520 2020-11-20T11:18:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c00bdd0 con 0x7fbb3c004e90 2020-11-20T11:18:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb3c003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4f7fe700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb3c004520 0x7fbb3c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb54d68700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb3c004e90 0x7fbb3c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 -- 172.21.15.112:0/2199782542 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb3c004e90 msgr2=0x7fbb3c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb3c004e90 0x7fbb3c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 -- 172.21.15.112:0/2199782542 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb3c004520 msgr2=0x7fbb3c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb3c004520 0x7fbb3c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb54d68700 1 -- 172.21.15.112:0/2199782542 reap_dead start 2020-11-20T11:18:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 -- 172.21.15.112:0/2199782542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c003280 con 0x7fbb3c0037f0 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb3c003c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fbb4000c440 tx=0x7fbb50154df0).ready entity=mon.0 client_cookie=6008ea52527d5c74 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000ce20 con 0x7fbb3c0037f0 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb400072e0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.788+0000 7fbb4effd700 1 -- 172.21.15.112:0/2199782542 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40005630 con 0x7fbb3c0037f0 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 -- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 msgr2=0x7fbb3c003c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.799 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb3c003c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fbb4000c440 tx=0x7fbb50154df0).stop 2020-11-20T11:18:15.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 -- 172.21.15.112:0/2199782542 shutdown_connections 2020-11-20T11:18:15.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 --2- 172.21.15.112:0/2199782542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb3c003c10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 -- 172.21.15.112:0/2199782542 >> 172.21.15.112:0/2199782542 conn(0x7fbb5005bac0 msgr2=0x7fbb5005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.800 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 -- 172.21.15.112:0/2199782542 shutdown_connections 2020-11-20T11:18:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.789+0000 7fbb567cb700 1 -- 172.21.15.112:0/2199782542 wait complete. 2020-11-20T11:18:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.790+0000 7fbb567cb700 1 Processor -- start 2020-11-20T11:18:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.790+0000 7fbb567cb700 1 -- start start 2020-11-20T11:18:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 0x7fbb5014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb500c0420 0x7fbb500c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50161320 con 0x7fbb3c0037f0 2020-11-20T11:18:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500c0960 con 0x7fbb5014c610 2020-11-20T11:18:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500c0c00 con 0x7fbb500c0420 2020-11-20T11:18:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51168/0 (socket says 172.21.15.112:51168) 2020-11-20T11:18:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 -- 172.21.15.112:0/1596277500 learned_addr learned my addr 172.21.15.112:0/1596277500 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4f7fe700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 0x7fbb5014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb54d68700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb500c0420 0x7fbb500c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 -- 172.21.15.112:0/1596277500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb500c0420 msgr2=0x7fbb500c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb500c0420 0x7fbb500c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.806 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 -- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 msgr2=0x7fbb5014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 0x7fbb5014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 -- 172.21.15.112:0/1596277500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500c0ea0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4f7fe700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 0x7fbb5014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:15.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb4ffff700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbb4000cb90 tx=0x7fbb40013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.807 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4001a070 con 0x7fbb3c0037f0 2020-11-20T11:18:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40005bf0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5014cf60 con 0x7fbb3c0037f0 2020-11-20T11:18:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40013450 con 0x7fbb3c0037f0 2020-11-20T11:18:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.791+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5014db90 con 0x7fbb3c0037f0 2020-11-20T11:18:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.792+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb50152680 con 0x7fbb3c0037f0 2020-11-20T11:18:15.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.793+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbb40026070 con 0x7fbb3c0037f0 2020-11-20T11:18:15.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.793+0000 7fbb2ffff700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 0x7fbb28082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:15.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.794+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbb400a35e0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.809 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.794+0000 7fbb4f7fe700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 0x7fbb28082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:15.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.794+0000 7fbb4f7fe700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 0x7fbb28082b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbb50154420 tx=0x7fbb44009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:15.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.796+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbb40077ff0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.938 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.935+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbb5014d3c0 con 0x7fbb3c0037f0 2020-11-20T11:18:15.938 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.935+0000 7fbb2ffff700 1 -- 172.21.15.112:0/1596277500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb40024070 con 0x7fbb3c0037f0 2020-11-20T11:18:15.938 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2020-11-20T11:18:15.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 msgr2=0x7fbb28082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 0x7fbb28082b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbb50154420 tx=0x7fbb44009040).stop 2020-11-20T11:18:15.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 msgr2=0x7fbb50160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:15.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbb4000cb90 tx=0x7fbb40013000).stop 2020-11-20T11:18:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 shutdown_connections 2020-11-20T11:18:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fbb280806a0 0x7fbb28082b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb500c0420 0x7fbb500c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb3c0037f0 0x7fbb50160e30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 --2- 172.21.15.112:0/1596277500 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fbb5014c610 0x7fbb5014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:15.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 >> 172.21.15.112:0/1596277500 conn(0x7fbb5005bac0 msgr2=0x7fbb5014e230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:15.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 shutdown_connections 2020-11-20T11:18:15.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:15.937+0000 7fbb567cb700 1 -- 172.21.15.112:0/1596277500 wait complete. 2020-11-20T11:18:15.951 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:18:16.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.060+0000 7f4c6f59e700 1 Processor -- start 2020-11-20T11:18:16.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.060+0000 7f4c6f59e700 1 -- start start 2020-11-20T11:18:16.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6f59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c700bc020 0x7f4c700bd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6f59e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c700bded0 con 0x7f4c700bbc40 2020-11-20T11:18:16.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6f59e700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c70151720 con 0x7f4c7014f510 2020-11-20T11:18:16.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6f59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c70062700 con 0x7f4c700bc020 2020-11-20T11:18:16.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c700bc020 0x7f4c700bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c700bc020 0x7f4c700bd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51180/0 (socket says 172.21.15.112:51180) 2020-11-20T11:18:16.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 -- 172.21.15.112:0/1936345674 learned_addr learned my addr 172.21.15.112:0/1936345674 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 -- 172.21.15.112:0/1936345674 >> v1:172.21.15.204:6789/0 conn(0x7f4c7014f510 legacy=0x7f4c7014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 -- 172.21.15.112:0/1936345674 >> v1:172.21.15.166:6789/0 conn(0x7f4c700bbc40 legacy=0x7f4c70061ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6d59a700 1 -- 172.21.15.112:0/1936345674 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690038752 0 0) 0x7f4c700bded0 con 0x7f4c700bbc40 2020-11-20T11:18:16.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 -- 172.21.15.112:0/1936345674 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c701519c0 con 0x7f4c700bc020 2020-11-20T11:18:16.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6dd9b700 1 --2- 172.21.15.112:0/1936345674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c700bc020 0x7f4c700bd810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f4c64009a10 tx=0x7f4c64006ef0).ready entity=mon.0 client_cookie=ae42ac7b7d8bce23 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6d59a700 1 -- 172.21.15.112:0/1936345674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6400b860 con 0x7f4c700bc020 2020-11-20T11:18:16.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6d59a700 1 -- 172.21.15.112:0/1936345674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64000e90 con 0x7f4c700bc020 2020-11-20T11:18:16.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.061+0000 7f4c6d59a700 1 -- 172.21.15.112:0/1936345674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6400bbd0 con 0x7f4c700bc020 2020-11-20T11:18:16.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1936345674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c700bc020 msgr2=0x7f4c700bd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1936345674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c700bc020 0x7f4c700bd810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f4c64009a10 tx=0x7f4c64006ef0).stop 2020-11-20T11:18:16.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1936345674 shutdown_connections 2020-11-20T11:18:16.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1936345674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c700bc020 0x7f4c700bd810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1936345674 >> 172.21.15.112:0/1936345674 conn(0x7f4c700642e0 msgr2=0x7f4c700618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1936345674 shutdown_connections 2020-11-20T11:18:16.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.062+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1936345674 wait complete. 2020-11-20T11:18:16.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.063+0000 7f4c6f59e700 1 Processor -- start 2020-11-20T11:18:16.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.063+0000 7f4c6f59e700 1 -- start start 2020-11-20T11:18:16.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c700bbc40 0x7f4c7014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c700bc020 0x7f4c700afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700ad0b0 con 0x7f4c7014f510 2020-11-20T11:18:16.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015ee80 con 0x7f4c700bc020 2020-11-20T11:18:16.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6f59e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701626a0 con 0x7f4c700bbc40 2020-11-20T11:18:16.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51186/0 (socket says 172.21.15.112:51186) 2020-11-20T11:18:16.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 -- 172.21.15.112:0/1180362114 learned_addr learned my addr 172.21.15.112:0/1180362114 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6dd9b700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c700bc020 0x7f4c700afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6e59c700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c700bbc40 0x7f4c7014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 -- 172.21.15.112:0/1180362114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c700bbc40 msgr2=0x7f4c7014cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c700bbc40 0x7f4c7014cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 -- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c700bc020 msgr2=0x7f4c700afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c700bc020 0x7f4c700afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 -- 172.21.15.112:0/1180362114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c70162940 con 0x7f4c7014f510 2020-11-20T11:18:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c6ed9d700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4c6800ca90 tx=0x7f4c6800cda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.064+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68003120 con 0x7f4c7014f510 2020-11-20T11:18:16.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.065+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6800a7e0 con 0x7f4c7014f510 2020-11-20T11:18:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.065+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800ab60 con 0x7f4c7014f510 2020-11-20T11:18:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.065+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c70162be0 con 0x7f4c7014f510 2020-11-20T11:18:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.065+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c70163120 con 0x7f4c7014f510 2020-11-20T11:18:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.065+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c70065730 con 0x7f4c7014f510 2020-11-20T11:18:16.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.066+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4c68019030 con 0x7f4c7014f510 2020-11-20T11:18:16.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.066+0000 7f4c5e7fc700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 0x7f4c44082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.067+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4c680a2210 con 0x7f4c7014f510 2020-11-20T11:18:16.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.067+0000 7f4c6e59c700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 0x7f4c44082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.067+0000 7f4c6e59c700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 0x7f4c44082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4c60003530 tx=0x7f4c60009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.070+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4c68076c20 con 0x7f4c7014f510 2020-11-20T11:18:16.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.210+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c700008d0 con 0x7f4c7014f510 2020-11-20T11:18:16.214 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.211+0000 7f4c5e7fc700 1 -- 172.21.15.112:0/1180362114 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c6807a240 con 0x7f4c7014f510 2020-11-20T11:18:16.214 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:16.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 msgr2=0x7f4c44082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.215 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 0x7f4c44082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4c60003530 tx=0x7f4c60009040).stop 2020-11-20T11:18:16.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 msgr2=0x7f4c700b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4c6800ca90 tx=0x7f4c6800cda0).stop 2020-11-20T11:18:16.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 shutdown_connections 2020-11-20T11:18:16.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c44080670 0x7f4c44082b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.216 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7014f510 0x7f4c700b0360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c700bbc40 0x7f4c7014cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 --2- 172.21.15.112:0/1180362114 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c700bc020 0x7f4c700afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 >> 172.21.15.112:0/1180362114 conn(0x7f4c700642e0 msgr2=0x7f4c7014f970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 shutdown_connections 2020-11-20T11:18:16.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.212+0000 7f4c6f59e700 1 -- 172.21.15.112:0/1180362114 wait complete. 2020-11-20T11:18:16.226 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:18:16.336 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.333+0000 7f27e496d700 1 Processor -- start 2020-11-20T11:18:16.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.333+0000 7f27e496d700 1 -- start start 2020-11-20T11:18:16.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27e496d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27e0065d30 0x7f27e0066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27e496d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00c5230 con 0x7f27e01512e0 2020-11-20T11:18:16.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27e496d700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e01549c0 con 0x7f27e00bfa50 2020-11-20T11:18:16.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27e496d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e0154c60 con 0x7f27e0065d30 2020-11-20T11:18:16.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27de59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27e0065d30 0x7f27e0066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27ded9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f27e01512e0 0x7f27e0151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35384/0 (socket says 172.21.15.112:35384) 2020-11-20T11:18:16.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.334+0000 7f27ded9d700 1 -- 172.21.15.112:0/2885350471 learned_addr learned my addr 172.21.15.112:0/2885350471 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:16.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27de59c700 1 -- 172.21.15.112:0/2885350471 >> v1:172.21.15.166:6789/0 conn(0x7f27e00bfa50 legacy=0x7f27e00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:16.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27de59c700 1 -- 172.21.15.112:0/2885350471 >> v1:172.21.15.112:6789/0 conn(0x7f27e01512e0 legacy=0x7f27e0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27de59c700 1 -- 172.21.15.112:0/2885350471 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0154f00 con 0x7f27e0065d30 2020-11-20T11:18:16.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27ddd9b700 1 -- 172.21.15.112:0/2885350471 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444386578 0 0) 0x7f27e00c5230 con 0x7f27e01512e0 2020-11-20T11:18:16.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27de59c700 1 --2- 172.21.15.112:0/2885350471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e0065d30 0x7f27e0066110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f27d0006fd0 tx=0x7f27d0006e30).ready entity=mon.0 client_cookie=d949c17f0d595b15 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27ddd9b700 1 -- 172.21.15.112:0/2885350471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00097a0 con 0x7f27e0065d30 2020-11-20T11:18:16.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27ddd9b700 1 -- 172.21.15.112:0/2885350471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0000e90 con 0x7f27e0065d30 2020-11-20T11:18:16.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27ddd9b700 1 -- 172.21.15.112:0/2885350471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0009b10 con 0x7f27e0065d30 2020-11-20T11:18:16.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 -- 172.21.15.112:0/2885350471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e0065d30 msgr2=0x7f27e0066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 --2- 172.21.15.112:0/2885350471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e0065d30 0x7f27e0066110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f27d0006fd0 tx=0x7f27d0006e30).stop 2020-11-20T11:18:16.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 -- 172.21.15.112:0/2885350471 shutdown_connections 2020-11-20T11:18:16.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 --2- 172.21.15.112:0/2885350471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e0065d30 0x7f27e0066110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 -- 172.21.15.112:0/2885350471 >> 172.21.15.112:0/2885350471 conn(0x7f27e005bac0 msgr2=0x7f27e005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 -- 172.21.15.112:0/2885350471 shutdown_connections 2020-11-20T11:18:16.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.335+0000 7f27e496d700 1 -- 172.21.15.112:0/2885350471 wait complete. 2020-11-20T11:18:16.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.336+0000 7f27e496d700 1 Processor -- start 2020-11-20T11:18:16.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 -- start start 2020-11-20T11:18:16.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e0065d30 0x7f27e0161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f27e00bfa50 0x7f27e00c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0164080 con 0x7f27e01512e0 2020-11-20T11:18:16.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0164320 con 0x7f27e00bfa50 2020-11-20T11:18:16.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27e496d700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01645c0 con 0x7f27e0065d30 2020-11-20T11:18:16.352 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27ded9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27ded9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51196/0 (socket says 172.21.15.112:51196) 2020-11-20T11:18:16.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27ded9d700 1 -- 172.21.15.112:0/2043257778 learned_addr learned my addr 172.21.15.112:0/2043257778 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.353 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.337+0000 7f27d7fff700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f27e00bfa50 0x7f27e00c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27de59c700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e0065d30 0x7f27e0161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 -- 172.21.15.112:0/2043257778 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e0065d30 msgr2=0x7f27e0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e0065d30 0x7f27e0161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 -- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f27e00bfa50 msgr2=0x7f27e00c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.354 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f27e00bfa50 0x7f27e00c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 -- 172.21.15.112:0/2043257778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0164860 con 0x7f27e01512e0 2020-11-20T11:18:16.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27ded9d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f27d800cae0 tx=0x7f27d8001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80020f0 con 0x7f27e01512e0 2020-11-20T11:18:16.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8005bc0 con 0x7f27e01512e0 2020-11-20T11:18:16.355 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e0164b00 con 0x7f27e01512e0 2020-11-20T11:18:16.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8007110 con 0x7f27e01512e0 2020-11-20T11:18:16.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.338+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00c0880 con 0x7f27e01512e0 2020-11-20T11:18:16.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.339+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e00c0ad0 con 0x7f27e01512e0 2020-11-20T11:18:16.356 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.339+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f27d8010030 con 0x7f27e01512e0 2020-11-20T11:18:16.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.340+0000 7f27d67fc700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 0x7f27bc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.340+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f27d80a27e0 con 0x7f27e01512e0 2020-11-20T11:18:16.357 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.340+0000 7f27de59c700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 0x7f27bc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.358 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.340+0000 7f27de59c700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 0x7f27bc082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f27d000bf90 tx=0x7f27d0015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.359 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.343+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f27d80771f0 con 0x7f27e01512e0 2020-11-20T11:18:16.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.483+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27e00666e0 con 0x7f27e01512e0 2020-11-20T11:18:16.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.484+0000 7f27d67fc700 1 -- 172.21.15.112:0/2043257778 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+10 (secure 0 0 0) 0x7f27d807a810 con 0x7f27e01512e0 2020-11-20T11:18:16.487 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:16.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 msgr2=0x7f27bc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 0x7f27bc082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f27d000bf90 tx=0x7f27d0015000).stop 2020-11-20T11:18:16.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 msgr2=0x7f27e00c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f27d800cae0 tx=0x7f27d8001360).stop 2020-11-20T11:18:16.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 shutdown_connections 2020-11-20T11:18:16.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f27bc080670 0x7f27bc082b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e01512e0 0x7f27e00c7c20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e0065d30 0x7f27e0161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 --2- 172.21.15.112:0/2043257778 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f27e00bfa50 0x7f27e00c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 >> 172.21.15.112:0/2043257778 conn(0x7f27e005bac0 msgr2=0x7f27e0152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 shutdown_connections 2020-11-20T11:18:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.485+0000 7f27e496d700 1 -- 172.21.15.112:0/2043257778 wait complete. 2020-11-20T11:18:16.499 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:18:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.609+0000 7f01abe5f700 1 Processor -- start 2020-11-20T11:18:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.609+0000 7f01abe5f700 1 -- start start 2020-11-20T11:18:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01abe5f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f01a40c5a10 0x7f01a40c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01abe5f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01a4155700 0x7f01a4061220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01abe5f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a41516b0 con 0x7f01a4061710 2020-11-20T11:18:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01abe5f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a4155b60 con 0x7f01a4155700 2020-11-20T11:18:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01abe5f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a41518e0 con 0x7f01a40c5a10 2020-11-20T11:18:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01a4155700 0x7f01a4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01a4155700 0x7f01a4061220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51200/0 (socket says 172.21.15.112:51200) 2020-11-20T11:18:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 -- 172.21.15.112:0/819999535 learned_addr learned my addr 172.21.15.112:0/819999535 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a9bfb700 1 --2- 172.21.15.112:0/819999535 >> v2:172.21.15.166:3300/0 conn(0x7f01a40c5a10 0x7f01a40c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 -- 172.21.15.112:0/819999535 >> v2:172.21.15.166:3300/0 conn(0x7f01a40c5a10 msgr2=0x7f01a40c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:16.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 --2- 172.21.15.112:0/819999535 >> v2:172.21.15.166:3300/0 conn(0x7f01a40c5a10 0x7f01a40c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 -- 172.21.15.112:0/819999535 >> v1:172.21.15.166:6789/0 conn(0x7f01a4061710 legacy=0x7f01a4064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 -- 172.21.15.112:0/819999535 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4151b80 con 0x7f01a4155700 2020-11-20T11:18:16.617 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a93fa700 1 --2- 172.21.15.112:0/819999535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4155700 0x7f01a4061220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f01a40c3370 tx=0x7f0194006ef0).ready entity=mon.0 client_cookie=37e4d4a740f7eb8d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.610+0000 7f01a8bf9700 1 -- 172.21.15.112:0/819999535 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400b860 con 0x7f01a4155700 2020-11-20T11:18:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01a8bf9700 1 -- 172.21.15.112:0/819999535 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194000e90 con 0x7f01a4155700 2020-11-20T11:18:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01a8bf9700 1 -- 172.21.15.112:0/819999535 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400bbd0 con 0x7f01a4155700 2020-11-20T11:18:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 -- 172.21.15.112:0/819999535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4155700 msgr2=0x7f01a4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 --2- 172.21.15.112:0/819999535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4155700 0x7f01a4061220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f01a40c3370 tx=0x7f0194006ef0).stop 2020-11-20T11:18:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 -- 172.21.15.112:0/819999535 shutdown_connections 2020-11-20T11:18:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 --2- 172.21.15.112:0/819999535 >> v2:172.21.15.166:3300/0 conn(0x7f01a40c5a10 0x7f01a40c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 --2- 172.21.15.112:0/819999535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4155700 0x7f01a4061220 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 -- 172.21.15.112:0/819999535 >> 172.21.15.112:0/819999535 conn(0x7f01a40bbc50 msgr2=0x7f01a40bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 -- 172.21.15.112:0/819999535 shutdown_connections 2020-11-20T11:18:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.611+0000 7f01abe5f700 1 -- 172.21.15.112:0/819999535 wait complete. 2020-11-20T11:18:16.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.612+0000 7f01abe5f700 1 Processor -- start 2020-11-20T11:18:16.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.612+0000 7f01abe5f700 1 -- start start 2020-11-20T11:18:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 0x7f01a40bc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a4155700 0x7f01a41584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4164b70 con 0x7f01a4061710 2020-11-20T11:18:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40be180 con 0x7f01a40c5a10 2020-11-20T11:18:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01abe5f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40be420 con 0x7f01a4155700 2020-11-20T11:18:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51206/0 (socket says 172.21.15.112:51206) 2020-11-20T11:18:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 -- 172.21.15.112:0/2764668751 learned_addr learned my addr 172.21.15.112:0/2764668751 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a93fa700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 0x7f01a40bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 -- 172.21.15.112:0/2764668751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a4155700 msgr2=0x7f01a41584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01aa3fc700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a4155700 0x7f01a41584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a4155700 0x7f01a41584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 -- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 msgr2=0x7f01a40bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 0x7f01a40bc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 -- 172.21.15.112:0/2764668751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40be6c0 con 0x7f01a4061710 2020-11-20T11:18:16.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a93fa700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 0x7f01a40bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.613+0000 7f01a9bfb700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f01a000eba0 tx=0x7f01a0006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.614+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000c9d0 con 0x7f01a4061710 2020-11-20T11:18:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.614+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000cb30 con 0x7f01a4061710 2020-11-20T11:18:16.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.614+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a40c23c0 con 0x7f01a4061710 2020-11-20T11:18:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.614+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00123f0 con 0x7f01a4061710 2020-11-20T11:18:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.614+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a40bf9f0 con 0x7f01a4061710 2020-11-20T11:18:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.615+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40666e0 con 0x7f01a4061710 2020-11-20T11:18:16.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.615+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f01a00127e0 con 0x7f01a4061710 2020-11-20T11:18:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.616+0000 7f0191ffb700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 0x7f017c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.616+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f01a00a2e50 con 0x7f01a4061710 2020-11-20T11:18:16.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.616+0000 7f01a93fa700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 0x7f017c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.616+0000 7f01a93fa700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 0x7f017c082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f01a40c3370 tx=0x7f0194016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.619+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f01a0077860 con 0x7f01a4061710 2020-11-20T11:18:16.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.760+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01a4065610 con 0x7f01a4061710 2020-11-20T11:18:16.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.761+0000 7f0191ffb700 1 -- 172.21.15.112:0/2764668751 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+10 (secure 0 0 0) 0x7f01a007ae80 con 0x7f01a4061710 2020-11-20T11:18:16.764 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 msgr2=0x7f017c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 0x7f017c082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f01a40c3370 tx=0x7f0194016000).stop 2020-11-20T11:18:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 msgr2=0x7f01a40bf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f01a000eba0 tx=0x7f01a0006e30).stop 2020-11-20T11:18:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 shutdown_connections 2020-11-20T11:18:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f017c080670 0x7f017c082b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a4155700 0x7f01a41584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a4061710 0x7f01a40bf2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 --2- 172.21.15.112:0/2764668751 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01a40c5a10 0x7f01a40bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 >> 172.21.15.112:0/2764668751 conn(0x7f01a40bbc50 msgr2=0x7f01a41541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 shutdown_connections 2020-11-20T11:18:16.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.763+0000 7f01abe5f700 1 -- 172.21.15.112:0/2764668751 wait complete. 2020-11-20T11:18:16.778 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:18:16.897 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 Processor -- start 2020-11-20T11:18:16.898 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 -- start start 2020-11-20T11:18:16.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5241519f0 0x7fb5240bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5240c5230 con 0x7fb524066110 2020-11-20T11:18:16.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5241549c0 con 0x7fb524065d30 2020-11-20T11:18:16.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.895+0000 7fb528f06700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240bff40 con 0x7fb5241519f0 2020-11-20T11:18:16.900 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb522d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5241519f0 0x7fb5240bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.901 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb51bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb524066110 0x7fb5241512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35408/0 (socket says 172.21.15.112:35408) 2020-11-20T11:18:16.901 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb51bfff700 1 -- 172.21.15.112:0/938003292 learned_addr learned my addr 172.21.15.112:0/938003292 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:16.901 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb522d9d700 1 -- 172.21.15.112:0/938003292 >> v1:172.21.15.166:6789/0 conn(0x7fb524065d30 legacy=0x7fb5240c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:16.902 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb522d9d700 1 -- 172.21.15.112:0/938003292 >> v1:172.21.15.112:6789/0 conn(0x7fb524066110 legacy=0x7fb5241512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.902 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb521d9b700 1 -- 172.21.15.112:0/938003292 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121357603 0 0) 0x7fb5240c5230 con 0x7fb524066110 2020-11-20T11:18:16.902 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb522d9d700 1 -- 172.21.15.112:0/938003292 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524154c60 con 0x7fb5241519f0 2020-11-20T11:18:16.902 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb522d9d700 1 --2- 172.21.15.112:0/938003292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241519f0 0x7fb5240bfa50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb51c009ce0 tx=0x7fb51c009220).ready entity=mon.0 client_cookie=605cc8e4d5a0aaa3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.902 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb521d9b700 1 -- 172.21.15.112:0/938003292 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00bbb0 con 0x7fb5241519f0 2020-11-20T11:18:16.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb521d9b700 1 -- 172.21.15.112:0/938003292 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c00bd10 con 0x7fb5241519f0 2020-11-20T11:18:16.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.896+0000 7fb521d9b700 1 -- 172.21.15.112:0/938003292 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c011610 con 0x7fb5241519f0 2020-11-20T11:18:16.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 -- 172.21.15.112:0/938003292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241519f0 msgr2=0x7fb5240bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 --2- 172.21.15.112:0/938003292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241519f0 0x7fb5240bfa50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb51c009ce0 tx=0x7fb51c009220).stop 2020-11-20T11:18:16.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 -- 172.21.15.112:0/938003292 shutdown_connections 2020-11-20T11:18:16.904 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 --2- 172.21.15.112:0/938003292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241519f0 0x7fb5240bfa50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.904 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 -- 172.21.15.112:0/938003292 >> 172.21.15.112:0/938003292 conn(0x7fb52405bac0 msgr2=0x7fb52405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:16.904 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 -- 172.21.15.112:0/938003292 shutdown_connections 2020-11-20T11:18:16.904 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.897+0000 7fb528f06700 1 -- 172.21.15.112:0/938003292 wait complete. 2020-11-20T11:18:16.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 Processor -- start 2020-11-20T11:18:16.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 -- start start 2020-11-20T11:18:16.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb524066110 0x7fb5240b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5241519f0 0x7fb524161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240b11d0 con 0x7fb524065d30 2020-11-20T11:18:16.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52414de10 con 0x7fb524066110 2020-11-20T11:18:16.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.898+0000 7fb528f06700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240b1410 con 0x7fb5241519f0 2020-11-20T11:18:16.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51220/0 (socket says 172.21.15.112:51220) 2020-11-20T11:18:16.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 -- 172.21.15.112:0/3016883539 learned_addr learned my addr 172.21.15.112:0/3016883539 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:16.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb522d9d700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5241519f0 0x7fb524161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb51bfff700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb524066110 0x7fb5240b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 -- 172.21.15.112:0/3016883539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5241519f0 msgr2=0x7fb524161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5241519f0 0x7fb524161aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 -- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb524066110 msgr2=0x7fb5240b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:16.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb524066110 0x7fb5240b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:16.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 -- 172.21.15.112:0/3016883539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524153650 con 0x7fb524065d30 2020-11-20T11:18:16.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb52259c700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb514009690 tx=0x7fb514006db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140113f0 con 0x7fb524065d30 2020-11-20T11:18:16.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514011570 con 0x7fb524065d30 2020-11-20T11:18:16.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241538f0 con 0x7fb524065d30 2020-11-20T11:18:16.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514011930 con 0x7fb524065d30 2020-11-20T11:18:16.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.899+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb524153e30 con 0x7fb524065d30 2020-11-20T11:18:16.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.900+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb524154e40 con 0x7fb524065d30 2020-11-20T11:18:16.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.901+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb514011ce0 con 0x7fb524065d30 2020-11-20T11:18:16.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.901+0000 7fb51a7fc700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 0x7fb500082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:16.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.901+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb5140a1fc0 con 0x7fb524065d30 2020-11-20T11:18:16.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.901+0000 7fb51bfff700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 0x7fb500082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:16.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.902+0000 7fb51bfff700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 0x7fb500082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb52405c220 tx=0x7fb50c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:16.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:16.904+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb5140769d0 con 0x7fb524065d30 2020-11-20T11:18:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.091+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb524153ff0 con 0x7fb524065d30 2020-11-20T11:18:17.096 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.092+0000 7fb51a7fc700 1 -- 172.21.15.112:0/3016883539 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2492 (secure 0 0 0) 0x7fb514079ff0 con 0x7fb524065d30 2020-11-20T11:18:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:17.096 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.166:6835/1658784600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6834","nonce":1658784600},{"type":"v1","addr":"172.21.15.166:6835","nonce":1658784600}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1046289868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1046289868},{"type":"v1","addr":"172.21.15.204:6833","nonce":1046289868}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:18:03.056969+0000","modified":"2020-11-20T11:18:05.061626+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6833/1222289625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1222289625},{"type":"v1","addr":"172.21.15.112:6833","nonce":1222289625}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:18:17.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 msgr2=0x7fb500082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:17.101 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 0x7fb500082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb52405c220 tx=0x7fb50c009040).stop 2020-11-20T11:18:17.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 msgr2=0x7fb5241542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:17.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb514009690 tx=0x7fb514006db0).stop 2020-11-20T11:18:17.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 shutdown_connections 2020-11-20T11:18:17.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb500080670 0x7fb500082b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:17.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5241519f0 0x7fb524161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:17.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb524065d30 0x7fb5241542d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:17.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 --2- 172.21.15.112:0/3016883539 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb524066110 0x7fb5240b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:17.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 >> 172.21.15.112:0/3016883539 conn(0x7fb52405bac0 msgr2=0x7fb52414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:17.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 shutdown_connections 2020-11-20T11:18:17.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:17.093+0000 7fb528f06700 1 -- 172.21.15.112:0/3016883539 wait complete. 2020-11-20T11:18:17.104 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 6 2020-11-20T11:18:17.414 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:18:03.056969+0000', 'modified': '2020-11-20T11:18:05.061626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4323': {'gid': 4323, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6833/1222289625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 1222289625}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 1222289625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:18:17.414 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:18:17.415 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T11:18:17.543 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","whoami":0,"id":4323,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.474629547999999,"mdsmap_epoch":6,"osdmap_epoch":29,"osdmap_epoch_barrier":29,"uptime":20.842788041999999} 2020-11-20T11:18:17.544 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3ec2328c-34d0-493f-8c83-5fdcfe44cc78", "fs_name": "cephfs", "id": 4323, "mdsmap_epoch": 6, "osdmap_epoch": 29, "osdmap_epoch_barrier": 29, "rank_uptime": 14.474629548, "state": "up:active", "uptime": 20.842788042, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:18:17.544 INFO:teuthology.run_tasks:Running task kclient... 2020-11-20T11:18:17.576 INFO:tasks.kclient:Mounting kernel clients... 2020-11-20T11:18:17.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.578 INFO:teuthology.orchestra.run.smithi112:> ip netns list 2020-11-20T11:18:17.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.596 INFO:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2020-11-20T11:18:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2020-11-20T11:18:17.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:18:17.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T11:18:17.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2020-11-20T11:18:17.673 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T11:18:17.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:17.674 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T11:18:17.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T11:18:17.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T11:18:17.675 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:18:17.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.676 INFO:teuthology.orchestra.run.smithi112:> ip addr 2020-11-20T11:18:17.728 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T11:18:17.728 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T11:18:17.729 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T11:18:17.729 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:18:17.729 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2020-11-20T11:18:17.730 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:18:17.730 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:18:17.730 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2020-11-20T11:18:17.730 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:18:17.731 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2020-11-20T11:18:17.731 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:18:17.731 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:18:17.731 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T11:18:17.732 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:18:17.732 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T11:18:17.733 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42771sec preferred_lft 42771sec 2020-11-20T11:18:17.733 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2020-11-20T11:18:17.733 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:18:17.734 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T11:18:17.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.736 INFO:teuthology.orchestra.run.smithi112:> (cd / && exec sudo bash -c ' 2020-11-20T11:18:17.736 INFO:teuthology.orchestra.run.smithi112:> set -e 2020-11-20T11:18:17.737 INFO:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2020-11-20T11:18:17.737 INFO:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2020-11-20T11:18:17.737 INFO:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2020-11-20T11:18:17.738 INFO:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T11:18:17.738 INFO:teuthology.orchestra.run.smithi112:> ') 2020-11-20T11:18:17.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.888 INFO:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T11:18:17.921 INFO:teuthology.orchestra.run.smithi112.stdout:1 2020-11-20T11:18:17.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.922 INFO:teuthology.orchestra.run.smithi112:> route 2020-11-20T11:18:17.996 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2020-11-20T11:18:17.996 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T11:18:17.996 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-11-20T11:18:17.997 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2020-11-20T11:18:17.997 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T11:18:17.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:17.998 INFO:teuthology.orchestra.run.smithi112:> (cd / && exec sudo bash -c ' 2020-11-20T11:18:17.998 INFO:teuthology.orchestra.run.smithi112:> set -e 2020-11-20T11:18:17.998 INFO:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T11:18:17.999 INFO:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T11:18:17.999 INFO:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T11:18:17.999 INFO:teuthology.orchestra.run.smithi112:> ') 2020-11-20T11:18:18.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:18.270 INFO:teuthology.orchestra.run.smithi112:> ip netns list 2020-11-20T11:18:18.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:18.286 INFO:teuthology.orchestra.run.smithi112:> ip netns list-id 2020-11-20T11:18:18.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:18.340 INFO:teuthology.orchestra.run.smithi112:> (cd / && exec sudo bash -c ' 2020-11-20T11:18:18.340 INFO:teuthology.orchestra.run.smithi112:> set -e 2020-11-20T11:18:18.341 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:18:18.341 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T11:18:18.341 INFO:teuthology.orchestra.run.smithi112:> ') 2020-11-20T11:18:18.345 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:18:18.383 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:18:18.386 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:18:18.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T11:18:18.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:18.427 INFO:teuthology.orchestra.run.smithi112:> (cd / && exec sudo bash -c ' 2020-11-20T11:18:18.427 INFO:teuthology.orchestra.run.smithi112:> set -e 2020-11-20T11:18:18.427 INFO:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T11:18:18.428 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T11:18:18.428 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T11:18:18.428 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T11:18:18.429 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T11:18:18.429 INFO:teuthology.orchestra.run.smithi112:> ') 2020-11-20T11:18:18.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:18.662 INFO:teuthology.orchestra.run.smithi112:> (cd / && exec sudo bash -c ' 2020-11-20T11:18:18.663 INFO:teuthology.orchestra.run.smithi112:> set -e 2020-11-20T11:18:18.663 INFO:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2020-11-20T11:18:18.663 INFO:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T11:18:18.664 INFO:teuthology.orchestra.run.smithi112:> ') 2020-11-20T11:18:18.759 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:18:18.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.870+0000 7f15d05ac700 1 Processor -- start 2020-11-20T11:18:18.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.870+0000 7f15d05ac700 1 -- start start 2020-11-20T11:18:18.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15d05ac700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15c8066110 0x7f15c80bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15d05ac700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 0x7f15c8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15d05ac700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80c5230 con 0x7f15c8065d30 2020-11-20T11:18:18.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15d05ac700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80bff40 con 0x7f15c8066110 2020-11-20T11:18:18.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15d05ac700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c81549c0 con 0x7f15c81512e0 2020-11-20T11:18:18.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15cdb47700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15c8066110 0x7f15c80bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15cdb47700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15c8066110 0x7f15c80bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51228/0 (socket says 172.21.15.112:51228) 2020-11-20T11:18:18.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.871+0000 7f15cdb47700 1 -- 172.21.15.112:0/986999955 learned_addr learned my addr 172.21.15.112:0/986999955 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:18.877 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15ceb49700 1 --2- 172.21.15.112:0/986999955 >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 0x7f15c8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cdb47700 1 -- 172.21.15.112:0/986999955 >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 msgr2=0x7f15c8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:18.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cdb47700 1 --2- 172.21.15.112:0/986999955 >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 0x7f15c8151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:18.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cdb47700 1 -- 172.21.15.112:0/986999955 >> v1:172.21.15.204:6789/0 conn(0x7f15c8065d30 legacy=0x7f15c80c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:18.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cdb47700 1 -- 172.21.15.112:0/986999955 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8154c60 con 0x7f15c8066110 2020-11-20T11:18:18.878 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15ceb49700 1 --2- 172.21.15.112:0/986999955 >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 0x7f15c8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:18.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cdb47700 1 --2- 172.21.15.112:0/986999955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80bfa50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f15c81548b0 tx=0x7f15b8006ef0).ready entity=mon.0 client_cookie=836dca4f2c480c6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:18.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cd346700 1 -- 172.21.15.112:0/986999955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800b820 con 0x7f15c8066110 2020-11-20T11:18:18.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cd346700 1 -- 172.21.15.112:0/986999955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8000e90 con 0x7f15c8066110 2020-11-20T11:18:18.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15cd346700 1 -- 172.21.15.112:0/986999955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800bb90 con 0x7f15c8066110 2020-11-20T11:18:18.879 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15d05ac700 1 -- 172.21.15.112:0/986999955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 msgr2=0x7f15c80bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:18.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15d05ac700 1 --2- 172.21.15.112:0/986999955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80bfa50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f15c81548b0 tx=0x7f15b8006ef0).stop 2020-11-20T11:18:18.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15d05ac700 1 -- 172.21.15.112:0/986999955 shutdown_connections 2020-11-20T11:18:18.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15d05ac700 1 --2- 172.21.15.112:0/986999955 >> v2:172.21.15.204:3300/0 conn(0x7f15c81512e0 0x7f15c8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:18.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.872+0000 7f15d05ac700 1 --2- 172.21.15.112:0/986999955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80bfa50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:18.880 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.873+0000 7f15d05ac700 1 -- 172.21.15.112:0/986999955 >> 172.21.15.112:0/986999955 conn(0x7f15c805bac0 msgr2=0x7f15c805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:18.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.873+0000 7f15d05ac700 1 -- 172.21.15.112:0/986999955 shutdown_connections 2020-11-20T11:18:18.881 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.873+0000 7f15d05ac700 1 -- 172.21.15.112:0/986999955 wait complete. 2020-11-20T11:18:18.883 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 Processor -- start 2020-11-20T11:18:18.883 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 -- start start 2020-11-20T11:18:18.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f15c8065d30 0x7f15c80b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c81512e0 0x7f15c80c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.884 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80b0d50 con 0x7f15c8066110 2020-11-20T11:18:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80b3080 con 0x7f15c8065d30 2020-11-20T11:18:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.874+0000 7f15d05ac700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80b0f80 con 0x7f15c81512e0 2020-11-20T11:18:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51234/0 (socket says 172.21.15.112:51234) 2020-11-20T11:18:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 -- 172.21.15.112:0/3731128995 learned_addr learned my addr 172.21.15.112:0/3731128995 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15ceb49700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c81512e0 0x7f15c80c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15ce348700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f15c8065d30 0x7f15c80b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 -- 172.21.15.112:0/3731128995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c81512e0 msgr2=0x7f15c80c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c81512e0 0x7f15c80c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 -- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f15c8065d30 msgr2=0x7f15c80b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f15c8065d30 0x7f15c80b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 -- 172.21.15.112:0/3731128995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80b1220 con 0x7f15c8066110 2020-11-20T11:18:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15cdb47700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f15c805d740 tx=0x7f15b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:18.887 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011e40 con 0x7f15c8066110 2020-11-20T11:18:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b801d480 con 0x7f15c8066110 2020-11-20T11:18:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c80b14c0 con 0x7f15c8066110 2020-11-20T11:18:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b801d840 con 0x7f15c8066110 2020-11-20T11:18:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.875+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c80b2dd0 con 0x7f15c8066110 2020-11-20T11:18:18.888 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.876+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c81546f0 con 0x7f15c8066110 2020-11-20T11:18:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.877+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f15b8017070 con 0x7f15c8066110 2020-11-20T11:18:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.877+0000 7f15b67fc700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 0x7f15a0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.877+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f15b80a4810 con 0x7f15c8066110 2020-11-20T11:18:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.877+0000 7f15ce348700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 0x7f15a0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.878+0000 7f15ce348700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 0x7f15a0082b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f15c400b670 tx=0x7f15c4008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:18.881+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f15b8079220 con 0x7f15c8066110 2020-11-20T11:18:19.025 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.022+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15c80bfb50 con 0x7f15c8066110 2020-11-20T11:18:19.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.023+0000 7f15b67fc700 1 -- 172.21.15.112:0/3731128995 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7f15b8015070 con 0x7f15c8066110 2020-11-20T11:18:19.026 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:19.027 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:18:19.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 msgr2=0x7f15a0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 0x7f15a0082b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f15c400b670 tx=0x7f15c4008040).stop 2020-11-20T11:18:19.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 msgr2=0x7f15c80c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f15c805d740 tx=0x7f15b8016000).stop 2020-11-20T11:18:19.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 shutdown_connections 2020-11-20T11:18:19.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15a0080670 0x7f15a0082b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15c81512e0 0x7f15c80c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f15c8065d30 0x7f15c80b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 --2- 172.21.15.112:0/3731128995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15c8066110 0x7f15c80c5d60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 >> 172.21.15.112:0/3731128995 conn(0x7f15c805bac0 msgr2=0x7f15c8060910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 shutdown_connections 2020-11-20T11:18:19.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.025+0000 7f15d05ac700 1 -- 172.21.15.112:0/3731128995 wait complete. 2020-11-20T11:18:19.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:17:46.086314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:17:55.502772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:17:58.012089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:18:00.733600+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:18:19.039 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:18:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 Processor -- start 2020-11-20T11:18:19.152 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 -- start start 2020-11-20T11:18:19.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f646c065d30 0x7f646c066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646c0bfa50 0x7f646c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f646c0c4c60 0x7f646c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c0c5230 con 0x7f646c0bfa50 2020-11-20T11:18:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c1549c0 con 0x7f646c0c4c60 2020-11-20T11:18:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.149+0000 7f64711aa700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c154c60 con 0x7f646c065d30 2020-11-20T11:18:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646c0bfa50 0x7f646c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646c0bfa50 0x7f646c0c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51244/0 (socket says 172.21.15.112:51244) 2020-11-20T11:18:19.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 -- 172.21.15.112:0/4143572735 learned_addr learned my addr 172.21.15.112:0/4143572735 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646b59e700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.166:3300/0 conn(0x7f646c0c4c60 0x7f646c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646ad9d700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.204:3300/0 conn(0x7f646c065d30 0x7f646c066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 -- 172.21.15.112:0/4143572735 >> v2:172.21.15.204:3300/0 conn(0x7f646c065d30 msgr2=0x7f646c066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:19.157 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.204:3300/0 conn(0x7f646c065d30 0x7f646c066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.157 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 -- 172.21.15.112:0/4143572735 >> v2:172.21.15.166:3300/0 conn(0x7f646c0c4c60 msgr2=0x7f646c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:19.157 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.166:3300/0 conn(0x7f646c0c4c60 0x7f646c1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.157 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 -- 172.21.15.112:0/4143572735 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c154f00 con 0x7f646c0bfa50 2020-11-20T11:18:19.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f646a59c700 1 --2- 172.21.15.112:0/4143572735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0c4770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f646c0651b0 tx=0x7f645c006ef0).ready entity=mon.0 client_cookie=b9c38073bd414945 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f6469d9b700 1 -- 172.21.15.112:0/4143572735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00b830 con 0x7f646c0bfa50 2020-11-20T11:18:19.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f6469d9b700 1 -- 172.21.15.112:0/4143572735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c000e90 con 0x7f646c0bfa50 2020-11-20T11:18:19.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.150+0000 7f6469d9b700 1 -- 172.21.15.112:0/4143572735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00bba0 con 0x7f646c0bfa50 2020-11-20T11:18:19.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 -- 172.21.15.112:0/4143572735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 msgr2=0x7f646c0c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 --2- 172.21.15.112:0/4143572735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0c4770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f646c0651b0 tx=0x7f645c006ef0).stop 2020-11-20T11:18:19.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 -- 172.21.15.112:0/4143572735 shutdown_connections 2020-11-20T11:18:19.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.166:3300/0 conn(0x7f646c0c4c60 0x7f646c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 --2- 172.21.15.112:0/4143572735 >> v2:172.21.15.204:3300/0 conn(0x7f646c065d30 0x7f646c066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 --2- 172.21.15.112:0/4143572735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0c4770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 -- 172.21.15.112:0/4143572735 >> 172.21.15.112:0/4143572735 conn(0x7f646c05bac0 msgr2=0x7f646c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 -- 172.21.15.112:0/4143572735 shutdown_connections 2020-11-20T11:18:19.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.151+0000 7f64711aa700 1 -- 172.21.15.112:0/4143572735 wait complete. 2020-11-20T11:18:19.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.152+0000 7f64711aa700 1 Processor -- start 2020-11-20T11:18:19.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.152+0000 7f64711aa700 1 -- start start 2020-11-20T11:18:19.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f646c065d30 0x7f646c161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f646c0c4c60 0x7f646c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c161730 con 0x7f646c0bfa50 2020-11-20T11:18:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c6710 con 0x7f646c065d30 2020-11-20T11:18:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f64711aa700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c69b0 con 0x7f646c0c4c60 2020-11-20T11:18:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51246/0 (socket says 172.21.15.112:51246) 2020-11-20T11:18:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 -- 172.21.15.112:0/2580017068 learned_addr learned my addr 172.21.15.112:0/2580017068 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646b59e700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f646c0c4c60 0x7f646c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 -- 172.21.15.112:0/2580017068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f646c0c4c60 msgr2=0x7f646c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f646c0c4c60 0x7f646c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646ad9d700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f646c065d30 0x7f646c161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 -- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f646c065d30 msgr2=0x7f646c161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f646c065d30 0x7f646c161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 -- 172.21.15.112:0/2580017068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0c6c50 con 0x7f646c0bfa50 2020-11-20T11:18:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f646a59c700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f645c00bd50 tx=0x7f645c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.153+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011c60 con 0x7f646c0bfa50 2020-11-20T11:18:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.154+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c011dc0 con 0x7f646c0bfa50 2020-11-20T11:18:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.154+0000 7f64711aa700 1 -- 172.21.15.112:0/2580017068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c0c6ef0 con 0x7f646c0bfa50 2020-11-20T11:18:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.154+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c01d6d0 con 0x7f646c0bfa50 2020-11-20T11:18:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.154+0000 7f64711aa700 1 -- 172.21.15.112:0/2580017068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c152a80 con 0x7f646c0bfa50 2020-11-20T11:18:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.155+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c004fd0 con 0x7f646c0bfa50 2020-11-20T11:18:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.155+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f645c017070 con 0x7f646c0bfa50 2020-11-20T11:18:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.156+0000 7f6452ffd700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 0x7f6448082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.156+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f645c0a47c0 con 0x7f646c0bfa50 2020-11-20T11:18:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.156+0000 7f646ad9d700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 0x7f6448082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.156+0000 7f646ad9d700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 0x7f6448082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f64600095f0 tx=0x7f6460008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.159+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f645c0791d0 con 0x7f646c0bfa50 2020-11-20T11:18:19.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.300+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f643c0016a0 con 0x7f646c0bfa50 2020-11-20T11:18:19.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.300+0000 7f6452ffd700 1 -- 172.21.15.112:0/2580017068 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7f645c015020 con 0x7f646c0bfa50 2020-11-20T11:18:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2020-11-20T11:18:19.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 msgr2=0x7f6448082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 0x7f6448082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f64600095f0 tx=0x7f6460008040).stop 2020-11-20T11:18:19.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 msgr2=0x7f646c0b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f645c00bd50 tx=0x7f645c016000).stop 2020-11-20T11:18:19.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 shutdown_connections 2020-11-20T11:18:19.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6448080670 0x7f6448082b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f646c0c4c60 0x7f646c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f646c065d30 0x7f646c161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 --2- 172.21.15.112:0/2580017068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646c0bfa50 0x7f646c0b17d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 >> 172.21.15.112:0/2580017068 conn(0x7f646c05bac0 msgr2=0x7f646c14fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 shutdown_connections 2020-11-20T11:18:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.302+0000 7f6450ff9700 1 -- 172.21.15.112:0/2580017068 wait complete. 2020-11-20T11:18:19.316 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:18:19.427 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.424+0000 7f16d98ae700 1 Processor -- start 2020-11-20T11:18:19.428 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d98ae700 1 -- start start 2020-11-20T11:18:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d98ae700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16d4061930 0x7f16d40c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d98ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d41516b0 con 0x7f16d4155700 2020-11-20T11:18:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d98ae700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d41518e0 con 0x7f16d40c5a10 2020-11-20T11:18:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d98ae700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d4155b90 con 0x7f16d4061930 2020-11-20T11:18:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.425+0000 7f16d27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16d4061930 0x7f16d40c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16d4061930 0x7f16d40c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51254/0 (socket says 172.21.15.112:51254) 2020-11-20T11:18:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 -- 172.21.15.112:0/2901980165 learned_addr learned my addr 172.21.15.112:0/2901980165 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d37fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16d4155700 0x7f16d4064720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35448/0 (socket says 172.21.15.112:35448) 2020-11-20T11:18:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 -- 172.21.15.112:0/2901980165 >> v1:172.21.15.204:6789/0 conn(0x7f16d40c5a10 legacy=0x7f16d4061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 -- 172.21.15.112:0/2901980165 >> v1:172.21.15.112:6789/0 conn(0x7f16d4155700 legacy=0x7f16d4064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 -- 172.21.15.112:0/2901980165 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4151b80 con 0x7f16d4061930 2020-11-20T11:18:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d1ffb700 1 -- 172.21.15.112:0/2901980165 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841370978 0 0) 0x7f16d41516b0 con 0x7f16d4155700 2020-11-20T11:18:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d27fc700 1 --2- 172.21.15.112:0/2901980165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d4061930 0x7f16d40c5df0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f16c8009a10 tx=0x7f16c8006ef0).ready entity=mon.0 client_cookie=15577c9b700deefe server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d1ffb700 1 -- 172.21.15.112:0/2901980165 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800b820 con 0x7f16d4061930 2020-11-20T11:18:19.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d1ffb700 1 -- 172.21.15.112:0/2901980165 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8000e90 con 0x7f16d4061930 2020-11-20T11:18:19.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d1ffb700 1 -- 172.21.15.112:0/2901980165 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800bb90 con 0x7f16d4061930 2020-11-20T11:18:19.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.426+0000 7f16d98ae700 1 -- 172.21.15.112:0/2901980165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d4061930 msgr2=0x7f16d40c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 --2- 172.21.15.112:0/2901980165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d4061930 0x7f16d40c5df0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f16c8009a10 tx=0x7f16c8006ef0).stop 2020-11-20T11:18:19.433 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 -- 172.21.15.112:0/2901980165 shutdown_connections 2020-11-20T11:18:19.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 --2- 172.21.15.112:0/2901980165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d4061930 0x7f16d40c5df0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 -- 172.21.15.112:0/2901980165 >> 172.21.15.112:0/2901980165 conn(0x7f16d40bbc50 msgr2=0x7f16d40bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 -- 172.21.15.112:0/2901980165 shutdown_connections 2020-11-20T11:18:19.434 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.427+0000 7f16d98ae700 1 -- 172.21.15.112:0/2901980165 wait complete. 2020-11-20T11:18:19.437 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.428+0000 7f16d98ae700 1 Processor -- start 2020-11-20T11:18:19.437 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.428+0000 7f16d98ae700 1 -- start start 2020-11-20T11:18:19.437 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16d4061930 0x7f16d40c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.437 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16d4155700 0x7f16d40bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41163d0 con 0x7f16d40c5a10 2020-11-20T11:18:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40bf790 con 0x7f16d4061930 2020-11-20T11:18:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41165c0 con 0x7f16d4155700 2020-11-20T11:18:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51260/0 (socket says 172.21.15.112:51260) 2020-11-20T11:18:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 -- 172.21.15.112:0/1049551563 learned_addr learned my addr 172.21.15.112:0/1049551563 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d37fe700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16d4155700 0x7f16d40bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 -- 172.21.15.112:0/1049551563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16d4155700 msgr2=0x7f16d40bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16d4155700 0x7f16d40bf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 -- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16d4061930 msgr2=0x7f16d40c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16d4061930 0x7f16d40c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 -- 172.21.15.112:0/1049551563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4116860 con 0x7f16d40c5a10 2020-11-20T11:18:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d27fc700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f16c8006f30 tx=0x7f16c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8011db0 con 0x7f16d40c5a10 2020-11-20T11:18:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c801c440 con 0x7f16d40c5a10 2020-11-20T11:18:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d4116b00 con 0x7f16d40c5a10 2020-11-20T11:18:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c801c7c0 con 0x7f16d40c5a10 2020-11-20T11:18:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.429+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4160aa0 con 0x7f16d40c5a10 2020-11-20T11:18:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.430+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d4160640 con 0x7f16d40c5a10 2020-11-20T11:18:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.431+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f16c802c070 con 0x7f16d40c5a10 2020-11-20T11:18:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.431+0000 7f16baffd700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 0x7f16b0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.431+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f16c80a4c90 con 0x7f16d40c5a10 2020-11-20T11:18:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.432+0000 7f16d2ffd700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 0x7f16b0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.432+0000 7f16d2ffd700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 0x7f16b0082b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f16c40094e0 tx=0x7f16c40069f0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.434+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f16c8079620 con 0x7f16d40c5a10 2020-11-20T11:18:19.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.573+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16d4160c60 con 0x7f16d40c5a10 2020-11-20T11:18:19.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.573+0000 7f16baffd700 1 -- 172.21.15.112:0/1049551563 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f16c8020020 con 0x7f16d40c5a10 2020-11-20T11:18:19.577 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:19.577 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 msgr2=0x7f16b0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 0x7f16b0082b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f16c40094e0 tx=0x7f16c40069f0).stop 2020-11-20T11:18:19.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 msgr2=0x7f16d4163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f16c8006f30 tx=0x7f16c8016000).stop 2020-11-20T11:18:19.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 shutdown_connections 2020-11-20T11:18:19.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f16b0080670 0x7f16b0082b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16d4155700 0x7f16d40bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f16d4061930 0x7f16d40c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:18:19.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 --2- 172.21.15.112:0/1049551563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16d40c5a10 0x7f16d4163bc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 >> 172.21.15.112:0/1049551563 conn(0x7f16d40bbc50 msgr2=0x7f16d40bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 shutdown_connections 2020-11-20T11:18:19.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.575+0000 7f16d98ae700 1 -- 172.21.15.112:0/1049551563 wait complete. 2020-11-20T11:18:19.589 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:18:19.699 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.696+0000 7f97327ab700 1 Processor -- start 2020-11-20T11:18:19.699 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.696+0000 7f97327ab700 1 -- start start 2020-11-20T11:18:19.701 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.697+0000 7f97327ab700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f972c05bc80 0x7f972c05c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.697+0000 7f97327ab700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f972c0c4fa0 0x7f972c0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.697+0000 7f97327ab700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0c4d40 con 0x7f972c0c01c0 2020-11-20T11:18:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.697+0000 7f97327ab700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c154cc0 con 0x7f972c05bc80 2020-11-20T11:18:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.697+0000 7f97327ab700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c154f60 con 0x7f972c0c4fa0 2020-11-20T11:18:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f972c05bc80 0x7f972c05c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f972c05bc80 0x7f972c05c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:39262/0 (socket says 172.21.15.112:39262) 2020-11-20T11:18:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 -- 172.21.15.112:0/2333130373 learned_addr learned my addr 172.21.15.112:0/2333130373 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f9730fa8700 1 --2- 172.21.15.112:0/2333130373 >> v2:172.21.15.204:3300/0 conn(0x7f972c0c4fa0 0x7f972c0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 -- 172.21.15.112:0/2333130373 >> v2:172.21.15.204:3300/0 conn(0x7f972c0c4fa0 msgr2=0x7f972c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 --2- 172.21.15.112:0/2333130373 >> v2:172.21.15.204:3300/0 conn(0x7f972c0c4fa0 0x7f972c0bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 -- 172.21.15.112:0/2333130373 >> v1:172.21.15.204:6789/0 conn(0x7f972c0c01c0 legacy=0x7f972c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 -- 172.21.15.112:0/2333130373 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c155200 con 0x7f972c05bc80 2020-11-20T11:18:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f97317a9700 1 --2- 172.21.15.112:0/2333130373 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c05bc80 0x7f972c05c060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f972c0c1e30 tx=0x7f9728006ef0).ready entity=mon.1 client_cookie=6553803104bdd158 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f971bfff700 1 -- 172.21.15.112:0/2333130373 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800b860 con 0x7f972c05bc80 2020-11-20T11:18:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f971bfff700 1 -- 172.21.15.112:0/2333130373 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728000e90 con 0x7f972c05bc80 2020-11-20T11:18:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.698+0000 7f971bfff700 1 -- 172.21.15.112:0/2333130373 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800bbd0 con 0x7f972c05bc80 2020-11-20T11:18:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 -- 172.21.15.112:0/2333130373 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c05bc80 msgr2=0x7f972c05c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 --2- 172.21.15.112:0/2333130373 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c05bc80 0x7f972c05c060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f972c0c1e30 tx=0x7f9728006ef0).stop 2020-11-20T11:18:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 -- 172.21.15.112:0/2333130373 shutdown_connections 2020-11-20T11:18:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 --2- 172.21.15.112:0/2333130373 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c05bc80 0x7f972c05c060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 --2- 172.21.15.112:0/2333130373 >> v2:172.21.15.204:3300/0 conn(0x7f972c0c4fa0 0x7f972c0bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 -- 172.21.15.112:0/2333130373 >> 172.21.15.112:0/2333130373 conn(0x7f972c060820 msgr2=0x7f972c0624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 -- 172.21.15.112:0/2333130373 shutdown_connections 2020-11-20T11:18:19.707 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.699+0000 7f97327ab700 1 -- 172.21.15.112:0/2333130373 wait complete. 2020-11-20T11:18:19.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.700+0000 7f97327ab700 1 Processor -- start 2020-11-20T11:18:19.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.700+0000 7f97327ab700 1 -- start start 2020-11-20T11:18:19.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f972c05bc80 0x7f972c161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c0c01c0 0x7f972c065ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c161940 con 0x7f972c0c4fa0 2020-11-20T11:18:19.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c153460 con 0x7f972c0c01c0 2020-11-20T11:18:19.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c153700 con 0x7f972c05bc80 2020-11-20T11:18:19.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51276/0 (socket says 172.21.15.112:51276) 2020-11-20T11:18:19.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 -- 172.21.15.112:0/4132715890 learned_addr learned my addr 172.21.15.112:0/4132715890 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97317a9700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f972c05bc80 0x7f972c161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9730fa8700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c0c01c0 0x7f972c065ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 -- 172.21.15.112:0/4132715890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f972c05bc80 msgr2=0x7f972c161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f972c05bc80 0x7f972c161450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 -- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c0c01c0 msgr2=0x7f972c065ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c0c01c0 0x7f972c065ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.712 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 -- 172.21.15.112:0/4132715890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c1539a0 con 0x7f972c0c4fa0 2020-11-20T11:18:19.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f9731faa700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f972400c860 tx=0x7f9724002240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400a580 con 0x7f972c0c4fa0 2020-11-20T11:18:19.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400a6e0 con 0x7f972c0c4fa0 2020-11-20T11:18:19.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c153c40 con 0x7f972c0c4fa0 2020-11-20T11:18:19.713 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400aa80 con 0x7f972c0c4fa0 2020-11-20T11:18:19.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.701+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c154180 con 0x7f972c0c4fa0 2020-11-20T11:18:19.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.702+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c154340 con 0x7f972c0c4fa0 2020-11-20T11:18:19.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.703+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9724010070 con 0x7f972c0c4fa0 2020-11-20T11:18:19.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.703+0000 7f97197fa700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 0x7f9704082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.714 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.703+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f97240a2640 con 0x7f972c0c4fa0 2020-11-20T11:18:19.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.704+0000 7f97317a9700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 0x7f9704082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.704+0000 7f97317a9700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 0x7f9704082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f972800c010 tx=0x7f9728016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.715 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.707+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9724077050 con 0x7f972c0c4fa0 2020-11-20T11:18:19.848 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.846+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f972c0008d0 con 0x7f972c0c4fa0 2020-11-20T11:18:19.849 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.846+0000 7f97197fa700 1 -- 172.21.15.112:0/4132715890 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+10 (secure 0 0 0) 0x7f972407a670 con 0x7f972c0c4fa0 2020-11-20T11:18:19.849 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:19.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 msgr2=0x7f9704082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.850 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 0x7f9704082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f972800c010 tx=0x7f9728016000).stop 2020-11-20T11:18:19.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 msgr2=0x7f972c0b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f972400c860 tx=0x7f9724002240).stop 2020-11-20T11:18:19.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 shutdown_connections 2020-11-20T11:18:19.851 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f9704080670 0x7f9704082b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972c0c4fa0 0x7f972c0b1110 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f972c05bc80 0x7f972c161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 --2- 172.21.15.112:0/4132715890 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f972c0c01c0 0x7f972c065ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 >> 172.21.15.112:0/4132715890 conn(0x7f972c060820 msgr2=0x7f972c14e330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.852 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.847+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 shutdown_connections 2020-11-20T11:18:19.853 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.848+0000 7f97327ab700 1 -- 172.21.15.112:0/4132715890 wait complete. 2020-11-20T11:18:19.861 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:18:19.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.975+0000 7f161415d700 1 Processor -- start 2020-11-20T11:18:19.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.975+0000 7f161415d700 1 -- start start 2020-11-20T11:18:19.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f161415d700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 0x7f160c066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f161415d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f160c0bfa50 0x7f160c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f161415d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c0c5230 con 0x7f160c0c4c60 2020-11-20T11:18:19.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f161415d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c1549c0 con 0x7f160c0bfa50 2020-11-20T11:18:19.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f161415d700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c154c60 con 0x7f160c065d30 2020-11-20T11:18:19.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f160c0bfa50 0x7f160c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f160c0bfa50 0x7f160c0c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51280/0 (socket says 172.21.15.112:51280) 2020-11-20T11:18:19.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16126fa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f160c0c4c60 0x7f160c1512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35478/0 (socket says 172.21.15.112:35478) 2020-11-20T11:18:19.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 -- 172.21.15.112:0/2243239235 learned_addr learned my addr 172.21.15.112:0/2243239235 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1611ef9700 1 --2- 172.21.15.112:0/2243239235 >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 0x7f160c066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 -- 172.21.15.112:0/2243239235 >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 msgr2=0x7f160c066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:18:19.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 --2- 172.21.15.112:0/2243239235 >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 0x7f160c066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 -- 172.21.15.112:0/2243239235 >> v1:172.21.15.112:6789/0 conn(0x7f160c0c4c60 legacy=0x7f160c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1610ef7700 1 -- 172.21.15.112:0/2243239235 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207233758 0 0) 0x7f160c0c5230 con 0x7f160c0c4c60 2020-11-20T11:18:19.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 -- 172.21.15.112:0/2243239235 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c154f00 con 0x7f160c0bfa50 2020-11-20T11:18:19.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1611ef9700 1 --2- 172.21.15.112:0/2243239235 >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 0x7f160c066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:19.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f16116f8700 1 --2- 172.21.15.112:0/2243239235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0bfa50 0x7f160c0c4770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f160c0c79a0 tx=0x7f1608006ef0).ready entity=mon.0 client_cookie=338fad4b6d367283 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1610ef7700 1 -- 172.21.15.112:0/2243239235 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800b860 con 0x7f160c0bfa50 2020-11-20T11:18:19.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1610ef7700 1 -- 172.21.15.112:0/2243239235 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608000e90 con 0x7f160c0bfa50 2020-11-20T11:18:19.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.976+0000 7f1610ef7700 1 -- 172.21.15.112:0/2243239235 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800bbd0 con 0x7f160c0bfa50 2020-11-20T11:18:19.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 -- 172.21.15.112:0/2243239235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0bfa50 msgr2=0x7f160c0c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 --2- 172.21.15.112:0/2243239235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0bfa50 0x7f160c0c4770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f160c0c79a0 tx=0x7f1608006ef0).stop 2020-11-20T11:18:19.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 -- 172.21.15.112:0/2243239235 shutdown_connections 2020-11-20T11:18:19.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 --2- 172.21.15.112:0/2243239235 >> v2:172.21.15.166:3300/0 conn(0x7f160c065d30 0x7f160c066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 --2- 172.21.15.112:0/2243239235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0bfa50 0x7f160c0c4770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 -- 172.21.15.112:0/2243239235 >> 172.21.15.112:0/2243239235 conn(0x7f160c05bac0 msgr2=0x7f160c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:19.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 -- 172.21.15.112:0/2243239235 shutdown_connections 2020-11-20T11:18:19.986 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.977+0000 7f161415d700 1 -- 172.21.15.112:0/2243239235 wait complete. 2020-11-20T11:18:19.988 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.978+0000 7f161415d700 1 Processor -- start 2020-11-20T11:18:19.988 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.978+0000 7f161415d700 1 -- start start 2020-11-20T11:18:19.989 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 0x7f160c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.989 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 0x7f160c0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.989 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.989 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c160c00 con 0x7f160c0c4c60 2020-11-20T11:18:19.990 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c160ea0 con 0x7f160c065d30 2020-11-20T11:18:19.990 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c161140 con 0x7f160c0bfa50 2020-11-20T11:18:19.990 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.990 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51290/0 (socket says 172.21.15.112:51290) 2020-11-20T11:18:19.990 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 -- 172.21.15.112:0/1046331670 learned_addr learned my addr 172.21.15.112:0/1046331670 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16116f8700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 0x7f160c0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f1611ef9700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 0x7f160c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 -- 172.21.15.112:0/1046331670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 msgr2=0x7f160c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 0x7f160c0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 -- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 msgr2=0x7f160c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 0x7f160c0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 -- 172.21.15.112:0/1046331670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c1613e0 con 0x7f160c0c4c60 2020-11-20T11:18:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16116f8700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 0x7f160c0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f1611ef9700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 0x7f160c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:18:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f16126fa700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f160400cab0 tx=0x7f1604007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.993 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604005bd0 con 0x7f160c0c4c60 2020-11-20T11:18:19.993 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604005d30 con 0x7f160c0c4c60 2020-11-20T11:18:19.993 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.979+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c0c5ba0 con 0x7f160c0c4c60 2020-11-20T11:18:19.993 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.980+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604005ea0 con 0x7f160c0c4c60 2020-11-20T11:18:19.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.980+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c161b10 con 0x7f160c0c4c60 2020-11-20T11:18:19.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.980+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c0c5d30 con 0x7f160c0c4c60 2020-11-20T11:18:19.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.981+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1604010030 con 0x7f160c0c4c60 2020-11-20T11:18:19.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.982+0000 7f15f9ffb700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 0x7f15e4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:19.994 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.982+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f16040a2ba0 con 0x7f160c0c4c60 2020-11-20T11:18:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.982+0000 7f1611ef9700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 0x7f15e4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.982+0000 7f1611ef9700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 0x7f15e4082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f15fc00b810 tx=0x7f15fc008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:19.985+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f16040775b0 con 0x7f160c0c4c60 2020-11-20T11:18:20.127 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.124+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f160c0666e0 con 0x7f160c0c4c60 2020-11-20T11:18:20.127 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.124+0000 7f15f9ffb700 1 -- 172.21.15.112:0/1046331670 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+10 (secure 0 0 0) 0x7f160407abd0 con 0x7f160c0c4c60 2020-11-20T11:18:20.127 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2020-11-20T11:18:20.128 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.125+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 msgr2=0x7f15e4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.125+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 0x7f15e4082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f15fc00b810 tx=0x7f15fc008040).stop 2020-11-20T11:18:20.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 msgr2=0x7f160c0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f160400cab0 tx=0x7f1604007df0).stop 2020-11-20T11:18:20.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 shutdown_connections 2020-11-20T11:18:20.130 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f15e4080670 0x7f15e4082b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.130 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f160c0c4c60 0x7f160c0b17b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.130 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f160c065d30 0x7f160c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.130 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 --2- 172.21.15.112:0/1046331670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f160c0bfa50 0x7f160c0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.131 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 >> 172.21.15.112:0/1046331670 conn(0x7f160c05bac0 msgr2=0x7f160c0c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:20.131 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 shutdown_connections 2020-11-20T11:18:20.131 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.126+0000 7f161415d700 1 -- 172.21.15.112:0/1046331670 wait complete. 2020-11-20T11:18:20.140 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T11:18:20.140 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:18:20.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.246+0000 7f2a1f31f700 1 Processor -- start 2020-11-20T11:18:20.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.246+0000 7f2a1f31f700 1 -- start start 2020-11-20T11:18:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1f31f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2a181519f0 0x7f2a180bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:20.251 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1f31f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180c5230 con 0x7f2a18066110 2020-11-20T11:18:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1f31f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a181549c0 con 0x7f2a18065d30 2020-11-20T11:18:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1f31f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a180bff40 con 0x7f2a181519f0 2020-11-20T11:18:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1d8bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2a181519f0 0x7f2a180bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1c8ba700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2a18066110 0x7f2a181512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35488/0 (socket says 172.21.15.112:35488) 2020-11-20T11:18:20.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1c8ba700 1 -- 172.21.15.112:0/2877630637 learned_addr learned my addr 172.21.15.112:0/2877630637 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:18:20.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1d8bc700 1 -- 172.21.15.112:0/2877630637 >> v1:172.21.15.166:6789/0 conn(0x7f2a18065d30 legacy=0x7f2a180c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1d8bc700 1 -- 172.21.15.112:0/2877630637 >> v1:172.21.15.112:6789/0 conn(0x7f2a18066110 legacy=0x7f2a181512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a07fff700 1 -- 172.21.15.112:0/2877630637 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162512748 0 0) 0x7f2a180c5230 con 0x7f2a18066110 2020-11-20T11:18:20.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.247+0000 7f2a1d8bc700 1 -- 172.21.15.112:0/2877630637 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18154c60 con 0x7f2a181519f0 2020-11-20T11:18:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1d8bc700 1 --2- 172.21.15.112:0/2877630637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a181519f0 0x7f2a180bfa50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2a10009ce0 tx=0x7f2a10009220).ready entity=mon.0 client_cookie=d3640340c8969d1d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a07fff700 1 -- 172.21.15.112:0/2877630637 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000bbf0 con 0x7f2a181519f0 2020-11-20T11:18:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a07fff700 1 -- 172.21.15.112:0/2877630637 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000bd50 con 0x7f2a181519f0 2020-11-20T11:18:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a07fff700 1 -- 172.21.15.112:0/2877630637 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011610 con 0x7f2a181519f0 2020-11-20T11:18:20.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 -- 172.21.15.112:0/2877630637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a181519f0 msgr2=0x7f2a180bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/2877630637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a181519f0 0x7f2a180bfa50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2a10009ce0 tx=0x7f2a10009220).stop 2020-11-20T11:18:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 -- 172.21.15.112:0/2877630637 shutdown_connections 2020-11-20T11:18:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/2877630637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a181519f0 0x7f2a180bfa50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 -- 172.21.15.112:0/2877630637 >> 172.21.15.112:0/2877630637 conn(0x7f2a1805bac0 msgr2=0x7f2a1805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:20.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 -- 172.21.15.112:0/2877630637 shutdown_connections 2020-11-20T11:18:20.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.248+0000 7f2a1f31f700 1 -- 172.21.15.112:0/2877630637 wait complete. 2020-11-20T11:18:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 Processor -- start 2020-11-20T11:18:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 -- start start 2020-11-20T11:18:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 0x7f2a180c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a181519f0 0x7f2a180b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:20.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a181608d0 con 0x7f2a18066110 2020-11-20T11:18:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18160b70 con 0x7f2a18065d30 2020-11-20T11:18:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.250+0000 7f2a1f31f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18160e10 con 0x7f2a181519f0 2020-11-20T11:18:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51300/0 (socket says 172.21.15.112:51300) 2020-11-20T11:18:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 -- 172.21.15.112:0/3449422272 learned_addr learned my addr 172.21.15.112:0/3449422272 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:18:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1d0bb700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 0x7f2a180c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1d8bc700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a181519f0 0x7f2a180b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 -- 172.21.15.112:0/3449422272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a181519f0 msgr2=0x7f2a180b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a181519f0 0x7f2a180b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 -- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 msgr2=0x7f2a180c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 0x7f2a180c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 -- 172.21.15.112:0/3449422272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a181610b0 con 0x7f2a18066110 2020-11-20T11:18:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1d0bb700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 0x7f2a180c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:18:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1c8ba700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2a0800c760 tx=0x7f2a08007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08007320 con 0x7f2a18066110 2020-11-20T11:18:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08007480 con 0x7f2a18066110 2020-11-20T11:18:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a18161350 con 0x7f2a18066110 2020-11-20T11:18:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08005840 con 0x7f2a18066110 2020-11-20T11:18:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.251+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a180c2d70 con 0x7f2a18066110 2020-11-20T11:18:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.252+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a18163cc0 con 0x7f2a18066110 2020-11-20T11:18:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.253+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2a08010030 con 0x7f2a18066110 2020-11-20T11:18:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.254+0000 7f2a057fa700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 0x7f29f0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:18:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.254+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2a080a2ba0 con 0x7f2a18066110 2020-11-20T11:18:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.254+0000 7f2a1d0bb700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 0x7f29f0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:18:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.255+0000 7f2a1d0bb700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 0x7f29f0082b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2a14001530 tx=0x7f2a14009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:18:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.257+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2a080775b0 con 0x7f2a18066110 2020-11-20T11:18:20.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.444+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a18163cc0 con 0x7f2a18066110 2020-11-20T11:18:20.447 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.444+0000 7f2a057fa700 1 -- 172.21.15.112:0/3449422272 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2492 (secure 0 0 0) 0x7f2a18163cc0 con 0x7f2a18066110 2020-11-20T11:18:20.447 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:18:20.448 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.166:6835/1658784600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6834","nonce":1658784600},{"type":"v1","addr":"172.21.15.166:6835","nonce":1658784600}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/1046289868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1046289868},{"type":"v1","addr":"172.21.15.204:6833","nonce":1046289868}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:18:03.056969+0000","modified":"2020-11-20T11:18:05.061626+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4323":{"gid":4323,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6833/1222289625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1222289625},{"type":"v1","addr":"172.21.15.112:6833","nonce":1222289625}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:18:20.449 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 msgr2=0x7f29f0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.449 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 0x7f29f0082b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2a14001530 tx=0x7f2a14009040).stop 2020-11-20T11:18:20.449 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 msgr2=0x7f2a180c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:18:20.449 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f2a0800c760 tx=0x7f2a08007d20).stop 2020-11-20T11:18:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 shutdown_connections 2020-11-20T11:18:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f29f00806a0 0x7f29f0082b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a181519f0 0x7f2a180b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f2a18065d30 0x7f2a180c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 --2- 172.21.15.112:0/3449422272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a18066110 0x7f2a180c3170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:18:20.451 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 >> 172.21.15.112:0/3449422272 conn(0x7f2a1805bac0 msgr2=0x7f2a181512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:18:20.451 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 shutdown_connections 2020-11-20T11:18:20.451 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:18:20.446+0000 7f2a1f31f700 1 -- 172.21.15.112:0/3449422272 wait complete. 2020-11-20T11:18:20.452 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 6 2020-11-20T11:18:20.763 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:18:03.056969+0000', 'modified': '2020-11-20T11:18:05.061626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4323': {'gid': 4323, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6833/1222289625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 1222289625}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 1222289625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:18:20.764 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:18:20.765 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T11:18:20.892 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","whoami":0,"id":4323,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.822770618,"mdsmap_epoch":6,"osdmap_epoch":29,"osdmap_epoch_barrier":29,"uptime":24.190928535000001} 2020-11-20T11:18:20.892 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3ec2328c-34d0-493f-8c83-5fdcfe44cc78", "fs_name": "cephfs", "id": 4323, "mdsmap_epoch": 6, "osdmap_epoch": 29, "osdmap_epoch_barrier": 29, "rank_uptime": 17.822770618, "state": "up:active", "uptime": 24.190928535, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:18:20.893 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2020-11-20T11:18:20.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:20.893 INFO:teuthology.orchestra.run.smithi112:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:20.907 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T11:18:20.908 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:18:21.000 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:18:21.001 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T11:18:21.109 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:18:21.110 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T11:18:21.112 INFO:tasks.cephfs.kernel_mount:mount command passed 2020-11-20T11:18:21.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:18:21.113 INFO:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:21.140 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T11:18:21.156 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:18:21.157 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T11:18:21.157 INFO:tasks.workunit:timeout=3h 2020-11-20T11:18:21.157 INFO:tasks.workunit:cleanup=True 2020-11-20T11:18:21.158 INFO:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:21.196 INFO:teuthology.orchestra.run.smithi112.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:21.196 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2020-11-20T11:18:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 2eh/46d Inode: 1 Links: 2 2020-11-20T11:18:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:18:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:cephfs_t:s0 2020-11-20T11:18:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T11:18:21.198 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2020-11-20 11:18:03.059060952 +0000 2020-11-20T11:18:21.198 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2020-11-20 11:18:21.136836331 +0000 2020-11-20T11:18:21.198 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2020-11-20T11:18:21.198 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T11:18:21.199 INFO:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T11:18:21.267 INFO:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:18:21.381 INFO:tasks.workunit.client.0.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T11:18:48.461 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:18:48.463 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:18:48.466 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:10.771 INFO:tasks.workunit.client.0.smithi112.stderr:Note: switching to 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T11:19:10.771 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.772 INFO:tasks.workunit.client.0.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T11:19:10.772 INFO:tasks.workunit.client.0.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T11:19:10.772 INFO:tasks.workunit.client.0.smithi112.stderr:state without impacting any branches by switching back to a branch. 2020-11-20T11:19:10.772 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.772 INFO:tasks.workunit.client.0.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T11:19:10.773 INFO:tasks.workunit.client.0.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2020-11-20T11:19:10.773 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.773 INFO:tasks.workunit.client.0.smithi112.stderr: git switch -c 2020-11-20T11:19:10.773 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.773 INFO:tasks.workunit.client.0.smithi112.stderr:Or undo this operation with: 2020-11-20T11:19:10.774 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.774 INFO:tasks.workunit.client.0.smithi112.stderr: git switch - 2020-11-20T11:19:10.774 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.774 INFO:tasks.workunit.client.0.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2020-11-20T11:19:10.774 INFO:tasks.workunit.client.0.smithi112.stderr: 2020-11-20T11:19:10.775 INFO:tasks.workunit.client.0.smithi112.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T11:19:10.776 INFO:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T11:19:10.800 INFO:tasks.workunit.client.0.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T11:19:10.802 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:19:10.802 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T11:19:11.484 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T11:19:11.543 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T11:19:11.581 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:19:11.583 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:19:11.583 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T11:19:11.619 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:19:11.622 INFO:teuthology.orchestra.run.smithi112:> set -ex 2020-11-20T11:19:11.623 INFO:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:19:11.676 INFO:teuthology.orchestra.run.smithi112.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:19:11.677 INFO:teuthology.orchestra.run.smithi112.stdout:mon/rbd_snaps_ops.shmon/osd.shmon/config.shmon/pg_autoscaler.shmon/test_mon_osdmap_prune.shmon/pool_ops.shmon/ping.pymon/crush_ops.shmon/test_mon_config_key.pymon/auth_caps.shmon/caps.shmon/test_config_key_caps.shpost-file.shtrue.shceph-helpers-root.shceph-tests/ceph-admin-commands.sherasure-code/bench.sherasure-code/encode-decode-non-regression.shrgw/test_rgw_reshard.pyrgw/test_rgw_throttle.shrgw/s3_bucket_quota.plrgw/test_rgw_gc_log.shrgw/test_rgw_obj.shrgw/s3_multipart_upload.plrgw/test_rgw_orphan_list.shrgw/s3_user_quota.plrgw/run-reshard.shrgw/run-s3tests.shcephtool/test_daemon.shcephtool/test_kvstore_tool.shcephtool/test.shsuites/cephfs_journal_tool_smoke.shsuites/iogen.shsuites/pjd.shsuites/dbench.shsuites/iozone-sync.shsuites/fsx.shsuites/fsstress.shsuites/fio.shsuites/iozone.shsuites/blogbench.shsuites/dbench-short.shsuites/bonnie.shsuites/fsync-tester.shsuites/ffsb.shlibcephfs/test.shcls/test_cls_cmpomap.shcls/test_cls_numops.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_rbd.shcls/test_cls_refcount.shcls/test_cls_2pc_queue.shcls/test_cls_lock.shcls/test_cls_journal.shcls/test_cls_log.shcls/test_cls_rgw.shosdc/stress_objectcacher.shrbd/merge_diff.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_ha.shrbd/diff_continuous.shrbd/test_librbd.shrbd/test_lock_fence.shrbd/qemu_rebuild_object_map.shrbd/qemu-iotests.shrbd/test_rbd_mirror.shrbd/krbd_udev_enumerate.shrbd/test_admin_socket.shrbd/krbd_wac.shrbd/notify_slave.shrbd/test_librbd_python.shrbd/rbd_mirror_bootstrap.shrbd/test_rbd_tasks.shrbd/rbd-ggate.shrbd/rbd_mirror_helpers.shrbd/test_rbdmap_RBDMAPFILE.shrbd/verify_pool.shrbd/cli_generic.shrbd/image_read.shrbd/rbd_mirror_fsx_compare.shrbd/read-flags.shrbd/map-unmap.shrbd/journal.shrbd/krbd_udev_netns.shrbd/huge-tickets.shrbd/qemu_dynamic_features.shrbd/simple_big.shrbd/krbd_latest_osdmap_on_map.shrbd/krbd_namespaces.shrbd/rbd_groups.shrbd/krbd_udev_symlinks.shrbd/rbd_mirror_stress.shrbd/permissions.shrbd/notify_master.shrbd/rbd_mirror_fsx_prepare.shrbd/import_export.shrbd/issue-20295.shrbd/map-snapshot-io.shrbd/concurrent.shrbd/qos.shrbd/krbd_huge_osdmap.shrbd/krbd_exclusive_option.shrbd/diff.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd-nbd.shrbd/krbd_data_pool.shrbd/krbd_fallocate.shrbd/kernel.shrbd/rbd_mirror_journal.shrbd/rbd_mirror_snapshot.shkernel_untar_build.shmgr/test_localpool.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.shrestart/test-backtraces.pyfs/misc/mkpool_layout_vxattrs.shfs/misc/rstats.shfs/misc/subvolume.shfs/misc/filelock_interrupt.pyfs/misc/layout_vxattrs.shfs/misc/direct_io.pyfs/misc/filelock_deadlock.pyfs/misc/chmod.shfs/misc/multiple_rsync.shfs/misc/acl.shfs/misc/xattrs.shfs/misc/i_complete_vs_rename.shfs/misc/dirfrag.shfs/misc/trivial_sync.shfs/test_o_trunc.shfs/upgrade/volume_clientfs/test_python.shfs/multiclient_sync_read_eof.pyfs/quota/quota.shfs/snap-hierarchy.shfs/test_o_truncfs/norstats/kernel_untar_tar.shfs/snaps/snaptest-2.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-double-null.shfs/snaps/snaptest-0.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-git-ceph.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-1.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-snap-rename.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-realm-split.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-hardlink.shobjectstore/test_fuse.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shcephadm/create_iscsi_disks.shcephadm/test_cephadm.shcaps/mon_commands.shrest/test-restful.shrest/test_mgr_rest_api.pydirect_io/test_sync_iodirect_io/big.shdirect_io/test_short_dio_readdirect_io/misc.shdirect_io/direct_io_testrename/pri_nul.shrename/prepare.shrename/rem_nul.shrename/rem_pri.shrename/pri_rem.shrename/rem_rem.shrename/pri_pri.shrename/dir_pri_nul.shrename/dir_pri_pri.shrename/all.shrados/test_dedup_tool.shrados/test_large_omap_detection.pyrados/test_pool_access.shrados/test_rados_timeouts.shrados/stress_watch.shrados/clone.shrados/test_envlibrados_for_rocksdb.shrados/load-gen-mix.shrados/test.shrados/test_python.shrados/test_librados_build.shrados/test_hang.shrados/test_health_warnings.shrados/test_crash.shrados/load-gen-mix-small-long.shrados/test_cache_pool.shrados/test_alloc_hint.shrados/load-gen-big.shrados/load-gen-mostlyread.shrados/test_rados_tool.shrados/load-gen-mix-small.shrados/test_pool_quota.shrados/version_number_sanity.sh 2020-11-20T11:19:11.677 INFO:teuthology.orchestra.run.smithi112.stderr:9+1 records in 2020-11-20T11:19:11.678 INFO:teuthology.orchestra.run.smithi112.stderr:9+1 records out 2020-11-20T11:19:11.678 INFO:teuthology.orchestra.run.smithi112.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 3.9162e-05 s, 121 MB/s 2020-11-20T11:19:11.678 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2020-11-20T11:19:11.680 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2020-11-20T11:19:11.680 INFO:teuthology.orchestra.run.smithi112:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2020-11-20T11:19:11.753 INFO:tasks.workunit.client.0.smithi112.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T11:19:11.754 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:19:11.754 INFO:tasks.workunit.client.0.smithi112.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T11:19:11.763 INFO:tasks.workunit.client.0.smithi112.stdout:0 of 1 processes prepared for launch 0 sec 2020-11-20T11:19:11.863 INFO:tasks.workunit.client.0.smithi112.stdout:1 of 1 processes prepared for launch 0 sec 2020-11-20T11:19:11.864 INFO:tasks.workunit.client.0.smithi112.stdout:releasing clients 2020-11-20T11:19:12.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 3024 33.54 MB/sec warmup 1 sec latency 9.875 ms 2020-11-20T11:19:13.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 5948 23.54 MB/sec warmup 2 sec latency 8.468 ms 2020-11-20T11:19:14.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 8289 20.42 MB/sec warmup 3 sec latency 9.041 ms 2020-11-20T11:19:16.719 INFO:tasks.workunit.client.0.smithi112.stdout: 1 11332 19.63 MB/sec warmup 4 sec latency 10.455 ms 2020-11-20T11:19:16.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 14202 19.16 MB/sec warmup 5 sec latency 76.660 ms 2020-11-20T11:19:17.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 16662 17.52 MB/sec warmup 6 sec latency 17.865 ms 2020-11-20T11:19:18.545 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:18.548 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:18.550 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:18.863 INFO:tasks.workunit.client.0.smithi112.stdout: 1 18965 16.95 MB/sec warmup 7 sec latency 11.023 ms 2020-11-20T11:19:19.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 21892 16.97 MB/sec warmup 8 sec latency 36.124 ms 2020-11-20T11:19:20.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 24861 17.02 MB/sec warmup 9 sec latency 29.292 ms 2020-11-20T11:19:21.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 27176 16.17 MB/sec warmup 10 sec latency 87.361 ms 2020-11-20T11:19:22.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 29243 15.86 MB/sec warmup 11 sec latency 16.653 ms 2020-11-20T11:19:23.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 32303 16.09 MB/sec warmup 12 sec latency 9.258 ms 2020-11-20T11:19:24.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 35131 15.87 MB/sec warmup 13 sec latency 10.559 ms 2020-11-20T11:19:25.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 36933 15.52 MB/sec warmup 14 sec latency 73.119 ms 2020-11-20T11:19:26.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 39517 15.42 MB/sec warmup 15 sec latency 71.268 ms 2020-11-20T11:19:27.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 42425 15.36 MB/sec warmup 16 sec latency 12.134 ms 2020-11-20T11:19:28.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 44898 15.13 MB/sec warmup 17 sec latency 64.804 ms 2020-11-20T11:19:29.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 47061 15.02 MB/sec warmup 18 sec latency 9.604 ms 2020-11-20T11:19:30.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 50083 15.19 MB/sec warmup 19 sec latency 19.790 ms 2020-11-20T11:19:31.907 INFO:tasks.workunit.client.0.smithi112.stdout: 1 53232 15.31 MB/sec warmup 20 sec latency 9.349 ms 2020-11-20T11:19:32.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 55572 14.98 MB/sec warmup 21 sec latency 67.311 ms 2020-11-20T11:19:33.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 57586 14.88 MB/sec warmup 22 sec latency 27.456 ms 2020-11-20T11:19:34.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 60743 15.04 MB/sec warmup 23 sec latency 9.441 ms 2020-11-20T11:19:35.864 INFO:tasks.workunit.client.0.smithi112.stdout: 1 63950 15.15 MB/sec warmup 24 sec latency 12.552 ms 2020-11-20T11:19:37.292 INFO:tasks.workunit.client.0.smithi112.stdout: 1 66349 14.92 MB/sec warmup 25 sec latency 24.774 ms 2020-11-20T11:19:37.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 68304 14.81 MB/sec warmup 26 sec latency 160.388 ms 2020-11-20T11:19:38.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 68855 14.42 MB/sec warmup 27 sec latency 372.737 ms 2020-11-20T11:19:39.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 71248 14.40 MB/sec warmup 28 sec latency 63.741 ms 2020-11-20T11:19:40.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 73451 14.16 MB/sec warmup 29 sec latency 14.377 ms 2020-11-20T11:19:41.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 75584 14.15 MB/sec warmup 30 sec latency 7.963 ms 2020-11-20T11:19:42.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 78540 14.25 MB/sec warmup 31 sec latency 27.618 ms 2020-11-20T11:19:43.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 81107 14.20 MB/sec warmup 32 sec latency 100.202 ms 2020-11-20T11:19:44.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 83294 14.12 MB/sec warmup 33 sec latency 14.730 ms 2020-11-20T11:19:45.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 85843 14.12 MB/sec warmup 34 sec latency 14.810 ms 2020-11-20T11:19:46.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 88842 14.22 MB/sec warmup 35 sec latency 18.108 ms 2020-11-20T11:19:47.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 91227 14.08 MB/sec warmup 36 sec latency 10.485 ms 2020-11-20T11:19:48.606 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:48.612 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:48.616 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:19:48.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 93094 14.02 MB/sec warmup 37 sec latency 68.651 ms 2020-11-20T11:19:49.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 96109 14.13 MB/sec warmup 38 sec latency 17.995 ms 2020-11-20T11:19:50.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 98711 14.08 MB/sec warmup 39 sec latency 8.938 ms 2020-11-20T11:19:51.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 100583 13.96 MB/sec warmup 40 sec latency 10.619 ms 2020-11-20T11:19:52.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 103335 14.04 MB/sec warmup 41 sec latency 12.768 ms 2020-11-20T11:19:53.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 106211 14.05 MB/sec warmup 42 sec latency 11.358 ms 2020-11-20T11:19:54.866 INFO:tasks.workunit.client.0.smithi112.stdout: 1 107701 13.88 MB/sec warmup 43 sec latency 88.495 ms 2020-11-20T11:19:55.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 110455 13.95 MB/sec warmup 44 sec latency 14.088 ms 2020-11-20T11:19:56.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 113356 13.96 MB/sec warmup 45 sec latency 11.071 ms 2020-11-20T11:19:57.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 115882 13.91 MB/sec warmup 46 sec latency 9.517 ms 2020-11-20T11:19:58.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 117902 13.88 MB/sec warmup 47 sec latency 12.310 ms 2020-11-20T11:19:59.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 120921 13.98 MB/sec warmup 48 sec latency 12.015 ms 2020-11-20T11:20:00.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 123074 13.84 MB/sec warmup 49 sec latency 89.580 ms 2020-11-20T11:20:01.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 125056 13.82 MB/sec warmup 50 sec latency 13.737 ms 2020-11-20T11:20:02.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 127991 13.90 MB/sec warmup 51 sec latency 10.981 ms 2020-11-20T11:20:03.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 130176 13.78 MB/sec warmup 52 sec latency 72.047 ms 2020-11-20T11:20:04.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 132179 13.76 MB/sec warmup 53 sec latency 12.764 ms 2020-11-20T11:20:05.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 135035 13.84 MB/sec warmup 54 sec latency 67.380 ms 2020-11-20T11:20:06.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 137318 13.73 MB/sec warmup 55 sec latency 10.242 ms 2020-11-20T11:20:07.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 139280 13.71 MB/sec warmup 56 sec latency 11.745 ms 2020-11-20T11:20:08.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 141209 13.65 MB/sec warmup 57 sec latency 253.723 ms 2020-11-20T11:20:09.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 142239 13.54 MB/sec warmup 58 sec latency 321.890 ms 2020-11-20T11:20:10.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 144052 13.42 MB/sec warmup 59 sec latency 34.308 ms 2020-11-20T11:20:11.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 145995 13.42 MB/sec warmup 60 sec latency 14.692 ms 2020-11-20T11:20:12.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 149065 13.49 MB/sec warmup 61 sec latency 12.417 ms 2020-11-20T11:20:13.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 151418 13.41 MB/sec warmup 62 sec latency 42.502 ms 2020-11-20T11:20:14.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 153474 13.40 MB/sec warmup 63 sec latency 14.924 ms 2020-11-20T11:20:15.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 156482 13.47 MB/sec warmup 64 sec latency 14.341 ms 2020-11-20T11:20:16.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 158861 13.44 MB/sec warmup 65 sec latency 89.659 ms 2020-11-20T11:20:17.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 160890 13.39 MB/sec warmup 66 sec latency 13.374 ms 2020-11-20T11:20:18.702 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:18.804 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:18.810 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:18.867 INFO:tasks.workunit.client.0.smithi112.stdout: 1 163566 13.44 MB/sec warmup 67 sec latency 57.278 ms 2020-11-20T11:20:19.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 166194 13.43 MB/sec warmup 68 sec latency 11.571 ms 2020-11-20T11:20:20.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 168372 13.40 MB/sec warmup 69 sec latency 10.661 ms 2020-11-20T11:20:21.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 170878 13.41 MB/sec warmup 70 sec latency 12.661 ms 2020-11-20T11:20:22.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 173441 13.41 MB/sec warmup 71 sec latency 78.520 ms 2020-11-20T11:20:23.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 175490 13.38 MB/sec warmup 72 sec latency 12.776 ms 2020-11-20T11:20:24.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 178032 13.39 MB/sec warmup 73 sec latency 14.428 ms 2020-11-20T11:20:25.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 180999 13.44 MB/sec warmup 74 sec latency 16.450 ms 2020-11-20T11:20:26.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 183367 13.38 MB/sec warmup 75 sec latency 9.822 ms 2020-11-20T11:20:27.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 185195 13.36 MB/sec warmup 76 sec latency 103.103 ms 2020-11-20T11:20:28.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 188218 13.43 MB/sec warmup 77 sec latency 11.192 ms 2020-11-20T11:20:29.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 190602 13.37 MB/sec warmup 78 sec latency 13.501 ms 2020-11-20T11:20:30.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 192615 13.36 MB/sec warmup 79 sec latency 14.037 ms 2020-11-20T11:20:31.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 195481 13.41 MB/sec warmup 80 sec latency 15.007 ms 2020-11-20T11:20:32.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 197654 13.34 MB/sec warmup 81 sec latency 70.417 ms 2020-11-20T11:20:33.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 199631 13.33 MB/sec warmup 82 sec latency 17.832 ms 2020-11-20T11:20:34.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 202547 13.38 MB/sec warmup 83 sec latency 18.920 ms 2020-11-20T11:20:35.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 205167 13.37 MB/sec warmup 84 sec latency 13.800 ms 2020-11-20T11:20:36.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 206893 13.32 MB/sec warmup 85 sec latency 49.854 ms 2020-11-20T11:20:37.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 209693 13.36 MB/sec warmup 86 sec latency 13.062 ms 2020-11-20T11:20:38.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 211880 13.30 MB/sec warmup 87 sec latency 83.952 ms 2020-11-20T11:20:39.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 212664 13.22 MB/sec warmup 88 sec latency 253.668 ms 2020-11-20T11:20:40.868 INFO:tasks.workunit.client.0.smithi112.stdout: 1 213485 13.13 MB/sec warmup 89 sec latency 200.380 ms 2020-11-20T11:20:41.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 215445 13.07 MB/sec warmup 90 sec latency 17.553 ms 2020-11-20T11:20:42.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 217481 13.07 MB/sec warmup 91 sec latency 9.070 ms 2020-11-20T11:20:44.831 INFO:tasks.workunit.client.0.smithi112.stdout: 1 220360 13.11 MB/sec warmup 92 sec latency 15.572 ms 2020-11-20T11:20:44.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 222731 13.09 MB/sec warmup 93 sec latency 54.036 ms 2020-11-20T11:20:45.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 224745 13.06 MB/sec warmup 94 sec latency 8.200 ms 2020-11-20T11:20:46.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 227505 13.10 MB/sec warmup 95 sec latency 15.987 ms 2020-11-20T11:20:47.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 230077 13.10 MB/sec warmup 96 sec latency 14.393 ms 2020-11-20T11:20:48.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 231989 13.08 MB/sec warmup 97 sec latency 14.491 ms 2020-11-20T11:20:49.180 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:49.183 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:49.185 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:20:49.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 234426 13.09 MB/sec warmup 98 sec latency 75.430 ms 2020-11-20T11:20:50.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 236709 13.04 MB/sec warmup 99 sec latency 12.447 ms 2020-11-20T11:20:51.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 238599 13.03 MB/sec warmup 100 sec latency 11.098 ms 2020-11-20T11:20:52.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 241454 13.08 MB/sec warmup 101 sec latency 13.551 ms 2020-11-20T11:20:53.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 243738 13.03 MB/sec warmup 102 sec latency 14.256 ms 2020-11-20T11:20:54.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 245599 13.02 MB/sec warmup 103 sec latency 60.970 ms 2020-11-20T11:20:55.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 248625 13.07 MB/sec warmup 104 sec latency 12.970 ms 2020-11-20T11:20:56.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 251248 13.07 MB/sec warmup 105 sec latency 9.707 ms 2020-11-20T11:20:57.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 253100 13.03 MB/sec warmup 106 sec latency 15.232 ms 2020-11-20T11:20:58.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 255870 13.06 MB/sec warmup 107 sec latency 23.618 ms 2020-11-20T11:20:59.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 257857 13.01 MB/sec warmup 108 sec latency 133.315 ms 2020-11-20T11:21:00.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 259222 13.00 MB/sec warmup 109 sec latency 226.401 ms 2020-11-20T11:21:01.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 260661 12.93 MB/sec warmup 110 sec latency 24.134 ms 2020-11-20T11:21:02.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 262962 12.94 MB/sec warmup 111 sec latency 14.702 ms 2020-11-20T11:21:03.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 265838 12.95 MB/sec warmup 112 sec latency 11.868 ms 2020-11-20T11:21:04.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 267921 12.93 MB/sec warmup 113 sec latency 10.716 ms 2020-11-20T11:21:05.869 INFO:tasks.workunit.client.0.smithi112.stdout: 1 270281 12.93 MB/sec warmup 114 sec latency 12.143 ms 2020-11-20T11:21:06.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 272600 12.93 MB/sec warmup 115 sec latency 70.744 ms 2020-11-20T11:21:07.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 274402 12.89 MB/sec warmup 116 sec latency 17.514 ms 2020-11-20T11:21:08.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 277136 12.93 MB/sec warmup 117 sec latency 15.956 ms 2020-11-20T11:21:09.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 279691 12.92 MB/sec warmup 118 sec latency 14.994 ms 2020-11-20T11:21:10.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 281773 12.91 MB/sec warmup 119 sec latency 9.595 ms 2020-11-20T11:21:12.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 287079 14.41 MB/sec execute 1 sec latency 68.793 ms 2020-11-20T11:21:13.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 289222 12.27 MB/sec execute 2 sec latency 14.831 ms 2020-11-20T11:21:14.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 291559 12.82 MB/sec execute 3 sec latency 15.092 ms 2020-11-20T11:21:15.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 292701 10.91 MB/sec execute 4 sec latency 276.415 ms 2020-11-20T11:21:16.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 294706 11.41 MB/sec execute 5 sec latency 40.293 ms 2020-11-20T11:21:17.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 296802 10.72 MB/sec execute 6 sec latency 24.092 ms 2020-11-20T11:21:18.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 298763 10.99 MB/sec execute 7 sec latency 12.420 ms 2020-11-20T11:21:19.240 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:19.243 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:19.245 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:19.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 301659 11.79 MB/sec execute 8 sec latency 9.577 ms 2020-11-20T11:21:20.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 303939 11.42 MB/sec execute 9 sec latency 9.735 ms 2020-11-20T11:21:21.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 305805 11.51 MB/sec execute 10 sec latency 16.706 ms 2020-11-20T11:21:22.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 308768 12.05 MB/sec execute 11 sec latency 16.117 ms 2020-11-20T11:21:23.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 310528 11.61 MB/sec execute 12 sec latency 78.329 ms 2020-11-20T11:21:24.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 312755 11.77 MB/sec execute 13 sec latency 13.971 ms 2020-11-20T11:21:25.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 315458 11.96 MB/sec execute 14 sec latency 21.769 ms 2020-11-20T11:21:26.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 317263 11.82 MB/sec execute 15 sec latency 9.870 ms 2020-11-20T11:21:27.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 319681 11.95 MB/sec execute 16 sec latency 19.468 ms 2020-11-20T11:21:28.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 321828 11.72 MB/sec execute 17 sec latency 83.161 ms 2020-11-20T11:21:29.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 323784 11.74 MB/sec execute 18 sec latency 13.665 ms 2020-11-20T11:21:30.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 326623 12.06 MB/sec execute 19 sec latency 17.697 ms 2020-11-20T11:21:31.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 328900 11.87 MB/sec execute 20 sec latency 13.919 ms 2020-11-20T11:21:32.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 330759 11.87 MB/sec execute 21 sec latency 18.680 ms 2020-11-20T11:21:33.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 333513 12.10 MB/sec execute 22 sec latency 72.861 ms 2020-11-20T11:21:34.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 335568 11.89 MB/sec execute 23 sec latency 19.302 ms 2020-11-20T11:21:35.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 337183 11.94 MB/sec execute 24 sec latency 174.323 ms 2020-11-20T11:21:36.870 INFO:tasks.workunit.client.0.smithi112.stdout: 1 337711 11.49 MB/sec execute 25 sec latency 256.733 ms 2020-11-20T11:21:37.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 340171 11.54 MB/sec execute 26 sec latency 17.688 ms 2020-11-20T11:21:39.119 INFO:tasks.workunit.client.0.smithi112.stdout: 1 342158 11.52 MB/sec execute 27 sec latency 13.252 ms 2020-11-20T11:21:39.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 344514 11.61 MB/sec execute 28 sec latency 47.944 ms 2020-11-20T11:21:40.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 347392 11.71 MB/sec execute 29 sec latency 17.863 ms 2020-11-20T11:21:41.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 349296 11.65 MB/sec execute 30 sec latency 49.623 ms 2020-11-20T11:21:42.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 351750 11.72 MB/sec execute 31 sec latency 14.864 ms 2020-11-20T11:21:43.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 354684 11.90 MB/sec execute 32 sec latency 13.896 ms 2020-11-20T11:21:44.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 357034 11.80 MB/sec execute 33 sec latency 26.827 ms 2020-11-20T11:21:45.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 358916 11.81 MB/sec execute 34 sec latency 98.113 ms 2020-11-20T11:21:46.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 361597 11.88 MB/sec execute 35 sec latency 11.916 ms 2020-11-20T11:21:47.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 363440 11.83 MB/sec execute 36 sec latency 10.370 ms 2020-11-20T11:21:48.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 365897 11.89 MB/sec execute 37 sec latency 17.749 ms 2020-11-20T11:21:49.356 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:49.367 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:49.375 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:21:49.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 368337 11.90 MB/sec execute 38 sec latency 36.338 ms 2020-11-20T11:21:50.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 369873 11.79 MB/sec execute 39 sec latency 57.786 ms 2020-11-20T11:21:51.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 370067 11.52 MB/sec execute 40 sec latency 905.727 ms 2020-11-20T11:21:52.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 372426 11.62 MB/sec execute 41 sec latency 36.602 ms 2020-11-20T11:21:53.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 374123 11.51 MB/sec execute 42 sec latency 13.941 ms 2020-11-20T11:21:54.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 376409 11.56 MB/sec execute 43 sec latency 23.415 ms 2020-11-20T11:21:55.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 378504 11.48 MB/sec execute 44 sec latency 40.149 ms 2020-11-20T11:21:56.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 380363 11.48 MB/sec execute 45 sec latency 14.024 ms 2020-11-20T11:21:57.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 383103 11.60 MB/sec execute 46 sec latency 22.265 ms 2020-11-20T11:21:58.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 384868 11.51 MB/sec execute 47 sec latency 10.626 ms 2020-11-20T11:21:59.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 387127 11.55 MB/sec execute 48 sec latency 16.000 ms 2020-11-20T11:22:00.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 389549 11.55 MB/sec execute 49 sec latency 18.757 ms 2020-11-20T11:22:01.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 391143 11.49 MB/sec execute 50 sec latency 52.981 ms 2020-11-20T11:22:02.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 393975 11.62 MB/sec execute 51 sec latency 15.999 ms 2020-11-20T11:22:03.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 396065 11.53 MB/sec execute 52 sec latency 14.841 ms 2020-11-20T11:22:04.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 397908 11.55 MB/sec execute 53 sec latency 17.052 ms 2020-11-20T11:22:05.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 400307 11.57 MB/sec execute 54 sec latency 20.207 ms 2020-11-20T11:22:06.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 401994 11.51 MB/sec execute 55 sec latency 12.745 ms 2020-11-20T11:22:07.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 404652 11.60 MB/sec execute 56 sec latency 78.225 ms 2020-11-20T11:22:08.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 406843 11.53 MB/sec execute 57 sec latency 11.315 ms 2020-11-20T11:22:09.871 INFO:tasks.workunit.client.0.smithi112.stdout: 1 408751 11.55 MB/sec execute 58 sec latency 12.466 ms 2020-11-20T11:22:10.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 411637 11.65 MB/sec execute 59 sec latency 13.502 ms 2020-11-20T11:22:11.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 413840 11.59 MB/sec execute 60 sec latency 10.472 ms 2020-11-20T11:22:12.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 415515 11.60 MB/sec execute 61 sec latency 94.711 ms 2020-11-20T11:22:13.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 417800 11.59 MB/sec execute 62 sec latency 19.892 ms 2020-11-20T11:22:14.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 419470 11.55 MB/sec execute 63 sec latency 10.813 ms 2020-11-20T11:22:15.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 422206 11.63 MB/sec execute 64 sec latency 14.048 ms 2020-11-20T11:22:16.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 423781 11.55 MB/sec execute 65 sec latency 11.004 ms 2020-11-20T11:22:17.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 425399 11.52 MB/sec execute 66 sec latency 213.808 ms 2020-11-20T11:22:18.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 426231 11.42 MB/sec execute 67 sec latency 506.879 ms 2020-11-20T11:22:19.824 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:19.827 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:19.829 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:19.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 428009 11.35 MB/sec execute 68 sec latency 68.603 ms 2020-11-20T11:22:20.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 429458 11.36 MB/sec execute 69 sec latency 55.783 ms 2020-11-20T11:22:21.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 431426 11.28 MB/sec execute 70 sec latency 12.546 ms 2020-11-20T11:22:22.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 433362 11.31 MB/sec execute 71 sec latency 21.333 ms 2020-11-20T11:22:23.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 435642 11.31 MB/sec execute 72 sec latency 59.427 ms 2020-11-20T11:22:24.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 437125 11.27 MB/sec execute 73 sec latency 13.049 ms 2020-11-20T11:22:25.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 439487 11.29 MB/sec execute 74 sec latency 81.496 ms 2020-11-20T11:22:26.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 440991 11.25 MB/sec execute 75 sec latency 11.762 ms 2020-11-20T11:22:27.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 443624 11.32 MB/sec execute 76 sec latency 15.562 ms 2020-11-20T11:22:28.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 445545 11.25 MB/sec execute 77 sec latency 14.503 ms 2020-11-20T11:22:29.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 447348 11.28 MB/sec execute 78 sec latency 69.525 ms 2020-11-20T11:22:30.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 449425 11.23 MB/sec execute 79 sec latency 15.586 ms 2020-11-20T11:22:31.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 451234 11.24 MB/sec execute 80 sec latency 11.069 ms 2020-11-20T11:22:32.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 454035 11.31 MB/sec execute 81 sec latency 13.010 ms 2020-11-20T11:22:33.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 456130 11.26 MB/sec execute 82 sec latency 12.824 ms 2020-11-20T11:22:34.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 458149 11.29 MB/sec execute 83 sec latency 60.331 ms 2020-11-20T11:22:35.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 459843 11.47 MB/sec execute 84 sec latency 50.004 ms 2020-11-20T11:22:36.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 462580 11.50 MB/sec execute 85 sec latency 9.908 ms 2020-11-20T11:22:37.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 465263 11.53 MB/sec execute 86 sec latency 53.751 ms 2020-11-20T11:22:38.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 465704 11.45 MB/sec execute 87 sec latency 433.892 ms 2020-11-20T11:22:39.872 INFO:tasks.workunit.client.0.smithi112.stdout: 1 467055 11.38 MB/sec execute 88 sec latency 25.982 ms 2020-11-20T11:22:40.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 469354 11.41 MB/sec execute 89 sec latency 20.365 ms 2020-11-20T11:22:41.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 471715 11.41 MB/sec execute 90 sec latency 20.838 ms 2020-11-20T11:22:42.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 473612 11.39 MB/sec execute 91 sec latency 11.716 ms 2020-11-20T11:22:43.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 476395 11.45 MB/sec execute 92 sec latency 16.030 ms 2020-11-20T11:22:44.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 478557 11.41 MB/sec execute 93 sec latency 13.837 ms 2020-11-20T11:22:45.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 480141 11.41 MB/sec execute 94 sec latency 70.240 ms 2020-11-20T11:22:46.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 482389 11.41 MB/sec execute 95 sec latency 15.778 ms 2020-11-20T11:22:47.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 484031 11.38 MB/sec execute 96 sec latency 10.635 ms 2020-11-20T11:22:48.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 486573 11.41 MB/sec execute 97 sec latency 19.870 ms 2020-11-20T11:22:49.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 487924 11.36 MB/sec execute 98 sec latency 11.955 ms 2020-11-20T11:22:50.130 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:50.142 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:50.148 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:22:50.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 490446 11.40 MB/sec execute 99 sec latency 19.047 ms 2020-11-20T11:22:51.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 491827 11.35 MB/sec execute 100 sec latency 67.771 ms 2020-11-20T11:22:52.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 494331 11.38 MB/sec execute 101 sec latency 14.706 ms 2020-11-20T11:22:53.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 496830 11.39 MB/sec execute 102 sec latency 15.360 ms 2020-11-20T11:22:54.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 498674 11.37 MB/sec execute 103 sec latency 10.730 ms 2020-11-20T11:22:55.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 501334 11.42 MB/sec execute 104 sec latency 14.516 ms 2020-11-20T11:22:56.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 503383 11.38 MB/sec execute 105 sec latency 73.509 ms 2020-11-20T11:22:57.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 505299 11.39 MB/sec execute 106 sec latency 12.148 ms 2020-11-20T11:22:58.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 507997 11.44 MB/sec execute 107 sec latency 16.690 ms 2020-11-20T11:22:59.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 509592 11.40 MB/sec execute 108 sec latency 12.071 ms 2020-11-20T11:23:00.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 511866 11.42 MB/sec execute 109 sec latency 55.729 ms 2020-11-20T11:23:02.258 INFO:tasks.workunit.client.0.smithi112.stdout: 1 513559 11.37 MB/sec execute 110 sec latency 74.914 ms 2020-11-20T11:23:02.873 INFO:tasks.workunit.client.0.smithi112.stdout: 1 515583 11.39 MB/sec execute 111 sec latency 19.930 ms 2020-11-20T11:23:03.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 516654 11.33 MB/sec execute 112 sec latency 207.810 ms 2020-11-20T11:23:04.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 517905 11.28 MB/sec execute 113 sec latency 312.165 ms 2020-11-20T11:23:05.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 519331 11.26 MB/sec execute 114 sec latency 42.125 ms 2020-11-20T11:23:06.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 521232 11.23 MB/sec execute 115 sec latency 20.805 ms 2020-11-20T11:23:07.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 522958 11.23 MB/sec execute 116 sec latency 51.091 ms 2020-11-20T11:23:08.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 525737 11.28 MB/sec execute 117 sec latency 17.078 ms 2020-11-20T11:23:09.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 527413 11.24 MB/sec execute 118 sec latency 10.860 ms 2020-11-20T11:23:10.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 529748 11.27 MB/sec execute 119 sec latency 19.515 ms 2020-11-20T11:23:11.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 531831 11.24 MB/sec execute 120 sec latency 16.578 ms 2020-11-20T11:23:12.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 533620 11.24 MB/sec execute 121 sec latency 15.639 ms 2020-11-20T11:23:13.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 535808 11.25 MB/sec execute 122 sec latency 84.704 ms 2020-11-20T11:23:14.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 537317 11.22 MB/sec execute 123 sec latency 14.982 ms 2020-11-20T11:23:15.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 539791 11.24 MB/sec execute 124 sec latency 71.519 ms 2020-11-20T11:23:16.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 541404 11.22 MB/sec execute 125 sec latency 11.427 ms 2020-11-20T11:23:17.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 543778 11.24 MB/sec execute 126 sec latency 22.877 ms 2020-11-20T11:23:18.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 545410 11.20 MB/sec execute 127 sec latency 37.986 ms 2020-11-20T11:23:19.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 546534 11.17 MB/sec execute 128 sec latency 296.898 ms 2020-11-20T11:23:20.219 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:20.221 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:20.224 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:20.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 547736 11.13 MB/sec execute 129 sec latency 37.779 ms 2020-11-20T11:23:21.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 549573 11.11 MB/sec execute 130 sec latency 28.015 ms 2020-11-20T11:23:22.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 551335 11.11 MB/sec execute 131 sec latency 12.552 ms 2020-11-20T11:23:23.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 553409 11.11 MB/sec execute 132 sec latency 33.509 ms 2020-11-20T11:23:24.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 554950 11.09 MB/sec execute 133 sec latency 13.799 ms 2020-11-20T11:23:25.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 557552 11.11 MB/sec execute 134 sec latency 16.999 ms 2020-11-20T11:23:26.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 559345 11.10 MB/sec execute 135 sec latency 12.709 ms 2020-11-20T11:23:27.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 561675 11.12 MB/sec execute 136 sec latency 16.508 ms 2020-11-20T11:23:28.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 563825 11.10 MB/sec execute 137 sec latency 17.871 ms 2020-11-20T11:23:29.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 565529 11.10 MB/sec execute 138 sec latency 116.387 ms 2020-11-20T11:23:30.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 568137 11.12 MB/sec execute 139 sec latency 19.658 ms 2020-11-20T11:23:31.874 INFO:tasks.workunit.client.0.smithi112.stdout: 1 569779 11.12 MB/sec execute 140 sec latency 14.391 ms 2020-11-20T11:23:32.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 572172 11.13 MB/sec execute 141 sec latency 14.866 ms 2020-11-20T11:23:33.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 574223 11.11 MB/sec execute 142 sec latency 24.241 ms 2020-11-20T11:23:34.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 575974 11.11 MB/sec execute 143 sec latency 11.913 ms 2020-11-20T11:23:35.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 577852 11.09 MB/sec execute 144 sec latency 72.708 ms 2020-11-20T11:23:36.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 579556 11.09 MB/sec execute 145 sec latency 18.114 ms 2020-11-20T11:23:37.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 581735 11.09 MB/sec execute 146 sec latency 17.932 ms 2020-11-20T11:23:38.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 583317 11.07 MB/sec execute 147 sec latency 14.624 ms 2020-11-20T11:23:39.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 584425 11.03 MB/sec execute 148 sec latency 289.039 ms 2020-11-20T11:23:40.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 585891 11.02 MB/sec execute 149 sec latency 143.824 ms 2020-11-20T11:23:41.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 586881 10.98 MB/sec execute 150 sec latency 15.944 ms 2020-11-20T11:23:42.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 589409 11.00 MB/sec execute 151 sec latency 34.373 ms 2020-11-20T11:23:43.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 590879 10.97 MB/sec execute 152 sec latency 12.707 ms 2020-11-20T11:23:44.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 593418 11.01 MB/sec execute 153 sec latency 21.979 ms 2020-11-20T11:23:45.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 594940 10.98 MB/sec execute 154 sec latency 52.870 ms 2020-11-20T11:23:46.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 597112 10.99 MB/sec execute 155 sec latency 15.615 ms 2020-11-20T11:23:47.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 599197 10.97 MB/sec execute 156 sec latency 17.862 ms 2020-11-20T11:23:48.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 601044 10.98 MB/sec execute 157 sec latency 15.576 ms 2020-11-20T11:23:49.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 603603 11.00 MB/sec execute 158 sec latency 13.926 ms 2020-11-20T11:23:50.318 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:50.333 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:50.350 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:23:50.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 605035 10.97 MB/sec execute 159 sec latency 11.508 ms 2020-11-20T11:23:51.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 607462 11.00 MB/sec execute 160 sec latency 90.806 ms 2020-11-20T11:23:52.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 608984 10.97 MB/sec execute 161 sec latency 16.513 ms 2020-11-20T11:23:53.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 611203 10.99 MB/sec execute 162 sec latency 50.239 ms 2020-11-20T11:23:54.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 613240 10.97 MB/sec execute 163 sec latency 14.340 ms 2020-11-20T11:23:55.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 614993 10.97 MB/sec execute 164 sec latency 12.972 ms 2020-11-20T11:23:56.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 617045 10.96 MB/sec execute 165 sec latency 17.616 ms 2020-11-20T11:23:57.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 618706 10.96 MB/sec execute 166 sec latency 62.954 ms 2020-11-20T11:23:58.875 INFO:tasks.workunit.client.0.smithi112.stdout: 1 620967 10.97 MB/sec execute 167 sec latency 17.795 ms 2020-11-20T11:23:59.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 622411 10.94 MB/sec execute 168 sec latency 19.968 ms 2020-11-20T11:24:00.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 622785 10.89 MB/sec execute 169 sec latency 471.412 ms 2020-11-20T11:24:01.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 625017 10.91 MB/sec execute 170 sec latency 30.083 ms 2020-11-20T11:24:02.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 626069 10.87 MB/sec execute 171 sec latency 18.969 ms 2020-11-20T11:24:03.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 628704 10.90 MB/sec execute 172 sec latency 16.640 ms 2020-11-20T11:24:04.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 630255 10.87 MB/sec execute 173 sec latency 13.073 ms 2020-11-20T11:24:05.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 632534 10.89 MB/sec execute 174 sec latency 20.163 ms 2020-11-20T11:24:06.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 634562 10.87 MB/sec execute 175 sec latency 13.301 ms 2020-11-20T11:24:07.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 636173 10.88 MB/sec execute 176 sec latency 18.564 ms 2020-11-20T11:24:08.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 638105 10.86 MB/sec execute 177 sec latency 75.480 ms 2020-11-20T11:24:09.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 639814 10.86 MB/sec execute 178 sec latency 13.326 ms 2020-11-20T11:24:10.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 641827 10.85 MB/sec execute 179 sec latency 20.572 ms 2020-11-20T11:24:11.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 643483 10.85 MB/sec execute 180 sec latency 21.325 ms 2020-11-20T11:24:12.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 645698 10.85 MB/sec execute 181 sec latency 14.066 ms 2020-11-20T11:24:13.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 647155 10.84 MB/sec execute 182 sec latency 11.575 ms 2020-11-20T11:24:14.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 649329 10.84 MB/sec execute 183 sec latency 97.373 ms 2020-11-20T11:24:15.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 650607 10.82 MB/sec execute 184 sec latency 144.889 ms 2020-11-20T11:24:16.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 652806 10.83 MB/sec execute 185 sec latency 16.322 ms 2020-11-20T11:24:17.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 654230 10.81 MB/sec execute 186 sec latency 13.435 ms 2020-11-20T11:24:18.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 656418 10.82 MB/sec execute 187 sec latency 18.626 ms 2020-11-20T11:24:19.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 657746 10.79 MB/sec execute 188 sec latency 39.975 ms 2020-11-20T11:24:20.419 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:20.430 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:20.439 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:20.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 658515 10.76 MB/sec execute 189 sec latency 225.819 ms 2020-11-20T11:24:21.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 660155 10.75 MB/sec execute 190 sec latency 114.862 ms 2020-11-20T11:24:22.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 661274 10.73 MB/sec execute 191 sec latency 16.736 ms 2020-11-20T11:24:23.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 663529 10.73 MB/sec execute 192 sec latency 20.506 ms 2020-11-20T11:24:24.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 664900 10.71 MB/sec execute 193 sec latency 33.799 ms 2020-11-20T11:24:25.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 667266 10.72 MB/sec execute 194 sec latency 18.370 ms 2020-11-20T11:24:26.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 668601 10.70 MB/sec execute 195 sec latency 17.064 ms 2020-11-20T11:24:27.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 671227 10.73 MB/sec execute 196 sec latency 14.677 ms 2020-11-20T11:24:28.876 INFO:tasks.workunit.client.0.smithi112.stdout: 1 672414 10.70 MB/sec execute 197 sec latency 13.765 ms 2020-11-20T11:24:29.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 674992 10.73 MB/sec execute 198 sec latency 26.237 ms 2020-11-20T11:24:30.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 676219 10.70 MB/sec execute 199 sec latency 67.285 ms 2020-11-20T11:24:31.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 678520 10.72 MB/sec execute 200 sec latency 23.692 ms 2020-11-20T11:24:32.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 679918 10.69 MB/sec execute 201 sec latency 12.633 ms 2020-11-20T11:24:33.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 682143 10.71 MB/sec execute 202 sec latency 12.806 ms 2020-11-20T11:24:34.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 683633 10.68 MB/sec execute 203 sec latency 15.932 ms 2020-11-20T11:24:35.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 685756 10.70 MB/sec execute 204 sec latency 18.910 ms 2020-11-20T11:24:36.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 687068 10.67 MB/sec execute 205 sec latency 98.457 ms 2020-11-20T11:24:37.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 689272 10.68 MB/sec execute 206 sec latency 15.623 ms 2020-11-20T11:24:38.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 690928 10.66 MB/sec execute 207 sec latency 20.033 ms 2020-11-20T11:24:39.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 692867 10.67 MB/sec execute 208 sec latency 19.497 ms 2020-11-20T11:24:40.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 694267 10.65 MB/sec execute 209 sec latency 45.974 ms 2020-11-20T11:24:41.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 694970 10.61 MB/sec execute 210 sec latency 425.158 ms 2020-11-20T11:24:42.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 696409 10.61 MB/sec execute 211 sec latency 17.206 ms 2020-11-20T11:24:43.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 697320 10.57 MB/sec execute 212 sec latency 20.871 ms 2020-11-20T11:24:44.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 699793 10.60 MB/sec execute 213 sec latency 22.401 ms 2020-11-20T11:24:45.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 701089 10.58 MB/sec execute 214 sec latency 13.647 ms 2020-11-20T11:24:46.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 703217 10.59 MB/sec execute 215 sec latency 44.245 ms 2020-11-20T11:24:47.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 704363 10.55 MB/sec execute 216 sec latency 14.491 ms 2020-11-20T11:24:48.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 706763 10.58 MB/sec execute 217 sec latency 23.004 ms 2020-11-20T11:24:49.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 707857 10.55 MB/sec execute 218 sec latency 13.928 ms 2020-11-20T11:24:50.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 710225 10.57 MB/sec execute 219 sec latency 24.284 ms 2020-11-20T11:24:50.898 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:50.901 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:50.903 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:24:51.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 711296 10.54 MB/sec execute 220 sec latency 22.109 ms 2020-11-20T11:24:52.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 713417 10.54 MB/sec execute 221 sec latency 71.966 ms 2020-11-20T11:24:53.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 714743 10.52 MB/sec execute 222 sec latency 14.302 ms 2020-11-20T11:24:54.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 717308 10.55 MB/sec execute 223 sec latency 18.873 ms 2020-11-20T11:24:55.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 718723 10.53 MB/sec execute 224 sec latency 13.457 ms 2020-11-20T11:24:56.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 721002 10.54 MB/sec execute 225 sec latency 29.423 ms 2020-11-20T11:24:57.877 INFO:tasks.workunit.client.0.smithi112.stdout: 1 722349 10.52 MB/sec execute 226 sec latency 15.010 ms 2020-11-20T11:24:58.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 724533 10.53 MB/sec execute 227 sec latency 85.063 ms 2020-11-20T11:24:59.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 725901 10.52 MB/sec execute 228 sec latency 13.607 ms 2020-11-20T11:25:00.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 728050 10.52 MB/sec execute 229 sec latency 113.419 ms 2020-11-20T11:25:01.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 728431 10.48 MB/sec execute 230 sec latency 195.773 ms 2020-11-20T11:25:02.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 729399 10.46 MB/sec execute 231 sec latency 146.892 ms 2020-11-20T11:25:03.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 731148 10.45 MB/sec execute 232 sec latency 23.386 ms 2020-11-20T11:25:04.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 732308 10.43 MB/sec execute 233 sec latency 15.197 ms 2020-11-20T11:25:05.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 734507 10.44 MB/sec execute 234 sec latency 17.331 ms 2020-11-20T11:25:06.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 735843 10.43 MB/sec execute 235 sec latency 14.073 ms 2020-11-20T11:25:07.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 738028 10.43 MB/sec execute 236 sec latency 17.627 ms 2020-11-20T11:25:08.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 739331 10.42 MB/sec execute 237 sec latency 53.630 ms 2020-11-20T11:25:09.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 741514 10.43 MB/sec execute 238 sec latency 21.445 ms 2020-11-20T11:25:10.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 742934 10.41 MB/sec execute 239 sec latency 14.364 ms 2020-11-20T11:25:11.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 745060 10.42 MB/sec execute 240 sec latency 45.449 ms 2020-11-20T11:25:12.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 746479 10.41 MB/sec execute 241 sec latency 14.421 ms 2020-11-20T11:25:13.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 748698 10.41 MB/sec execute 242 sec latency 21.139 ms 2020-11-20T11:25:14.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 750032 10.40 MB/sec execute 243 sec latency 39.983 ms 2020-11-20T11:25:15.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 752231 10.40 MB/sec execute 244 sec latency 18.934 ms 2020-11-20T11:25:16.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 753671 10.39 MB/sec execute 245 sec latency 12.693 ms 2020-11-20T11:25:17.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 756324 10.42 MB/sec execute 246 sec latency 18.140 ms 2020-11-20T11:25:18.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 757752 10.40 MB/sec execute 247 sec latency 15.044 ms 2020-11-20T11:25:19.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 760185 10.42 MB/sec execute 248 sec latency 13.049 ms 2020-11-20T11:25:20.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 761758 10.40 MB/sec execute 249 sec latency 41.117 ms 2020-11-20T11:25:20.972 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:25:20.975 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:25:20.977 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:25:21.265 INFO:tasks.ceph.mds.a.smithi112.stderr:2020-11-20T11:25:21.262+0000 7f23fcd7f700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 29249) UID: 0 2020-11-20T11:25:21.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 763730 10.41 MB/sec execute 250 sec latency 100.668 ms 2020-11-20T11:25:22.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 764131 10.37 MB/sec execute 251 sec latency 343.961 ms 2020-11-20T11:25:23.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 765799 10.36 MB/sec execute 252 sec latency 52.916 ms 2020-11-20T11:25:24.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 767027 10.36 MB/sec execute 253 sec latency 29.233 ms 2020-11-20T11:25:25.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 767959 10.33 MB/sec execute 254 sec latency 14.843 ms 2020-11-20T11:25:26.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 770152 10.33 MB/sec execute 255 sec latency 26.585 ms 2020-11-20T11:25:27.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 771244 10.32 MB/sec execute 256 sec latency 20.079 ms 2020-11-20T11:25:28.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 773259 10.32 MB/sec execute 257 sec latency 18.329 ms 2020-11-20T11:25:29.878 INFO:tasks.workunit.client.0.smithi112.stdout: 1 774632 10.31 MB/sec execute 258 sec latency 15.743 ms 2020-11-20T11:25:30.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 776190 10.29 MB/sec execute 259 sec latency 48.552 ms 2020-11-20T11:25:31.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 777861 10.30 MB/sec execute 260 sec latency 38.830 ms 2020-11-20T11:25:32.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 779199 10.29 MB/sec execute 261 sec latency 15.805 ms 2020-11-20T11:25:33.929 INFO:tasks.workunit.client.0.smithi112.stdout: 1 781268 10.29 MB/sec execute 262 sec latency 22.214 ms 2020-11-20T11:25:34.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 782327 10.27 MB/sec execute 263 sec latency 16.803 ms 2020-11-20T11:25:35.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 784507 10.28 MB/sec execute 264 sec latency 27.890 ms 2020-11-20T11:25:36.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 785494 10.26 MB/sec execute 265 sec latency 58.813 ms 2020-11-20T11:25:37.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 787596 10.26 MB/sec execute 266 sec latency 21.848 ms 2020-11-20T11:25:38.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 788913 10.25 MB/sec execute 267 sec latency 14.839 ms 2020-11-20T11:25:39.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 790684 10.24 MB/sec execute 268 sec latency 22.744 ms 2020-11-20T11:25:40.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 792238 10.24 MB/sec execute 269 sec latency 14.403 ms 2020-11-20T11:25:41.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 793666 10.23 MB/sec execute 270 sec latency 36.870 ms 2020-11-20T11:25:42.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 795644 10.24 MB/sec execute 271 sec latency 66.138 ms 2020-11-20T11:25:43.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 797214 10.22 MB/sec execute 272 sec latency 22.220 ms 2020-11-20T11:25:44.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 799248 10.23 MB/sec execute 273 sec latency 14.253 ms 2020-11-20T11:25:45.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 801003 10.22 MB/sec execute 274 sec latency 22.330 ms 2020-11-20T11:25:46.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 802791 10.23 MB/sec execute 275 sec latency 13.470 ms 2020-11-20T11:25:47.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 804103 10.21 MB/sec execute 276 sec latency 38.391 ms 2020-11-20T11:25:48.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 806268 10.22 MB/sec execute 277 sec latency 15.475 ms 2020-11-20T11:25:49.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 807594 10.21 MB/sec execute 278 sec latency 19.902 ms 2020-11-20T11:25:50.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 809734 10.22 MB/sec execute 279 sec latency 15.246 ms 2020-11-20T11:25:51.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 810680 10.19 MB/sec execute 280 sec latency 21.891 ms 2020-11-20T11:25:52.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 812061 10.18 MB/sec execute 281 sec latency 185.382 ms 2020-11-20T11:25:53.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 812676 10.16 MB/sec execute 282 sec latency 295.471 ms 2020-11-20T11:25:54.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 813642 10.14 MB/sec execute 283 sec latency 51.477 ms 2020-11-20T11:25:55.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 814653 10.13 MB/sec execute 284 sec latency 25.396 ms 2020-11-20T11:25:56.879 INFO:tasks.workunit.client.0.smithi112.stdout: 1 816581 10.13 MB/sec execute 285 sec latency 24.428 ms 2020-11-20T11:25:57.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 818081 10.12 MB/sec execute 286 sec latency 11.585 ms 2020-11-20T11:25:58.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 820387 10.13 MB/sec execute 287 sec latency 34.040 ms 2020-11-20T11:25:59.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 822027 10.12 MB/sec execute 288 sec latency 18.498 ms 2020-11-20T11:26:00.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 824236 10.13 MB/sec execute 289 sec latency 12.044 ms 2020-11-20T11:26:02.010 INFO:tasks.workunit.client.0.smithi112.stdout: 1 826138 10.12 MB/sec execute 290 sec latency 19.768 ms 2020-11-20T11:26:02.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 827909 10.13 MB/sec execute 291 sec latency 25.706 ms 2020-11-20T11:26:03.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 830105 10.13 MB/sec execute 292 sec latency 19.532 ms 2020-11-20T11:26:04.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 831497 10.12 MB/sec execute 293 sec latency 95.485 ms 2020-11-20T11:26:05.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 833205 10.11 MB/sec execute 294 sec latency 21.310 ms 2020-11-20T11:26:06.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 834721 10.12 MB/sec execute 295 sec latency 14.722 ms 2020-11-20T11:26:07.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 836022 10.10 MB/sec execute 296 sec latency 24.291 ms 2020-11-20T11:26:08.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 838143 10.11 MB/sec execute 297 sec latency 15.560 ms 2020-11-20T11:26:09.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 839090 10.09 MB/sec execute 298 sec latency 62.563 ms 2020-11-20T11:26:10.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 841093 10.09 MB/sec execute 299 sec latency 28.579 ms 2020-11-20T11:26:12.346 INFO:tasks.workunit.client.0.smithi112.stdout: 1 842186 10.08 MB/sec execute 300 sec latency 43.490 ms 2020-11-20T11:26:12.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 843914 10.07 MB/sec execute 301 sec latency 48.659 ms 2020-11-20T11:26:13.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 844401 10.05 MB/sec execute 302 sec latency 519.602 ms 2020-11-20T11:26:14.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 845381 10.04 MB/sec execute 303 sec latency 64.152 ms 2020-11-20T11:26:15.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 845994 10.01 MB/sec execute 304 sec latency 34.128 ms 2020-11-20T11:26:16.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 847786 10.01 MB/sec execute 305 sec latency 45.827 ms 2020-11-20T11:26:17.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 849019 10.01 MB/sec execute 306 sec latency 22.137 ms 2020-11-20T11:26:18.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 850172 9.99 MB/sec execute 307 sec latency 41.891 ms 2020-11-20T11:26:19.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 852181 10.00 MB/sec execute 308 sec latency 17.617 ms 2020-11-20T11:26:20.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 853044 9.97 MB/sec execute 309 sec latency 27.701 ms 2020-11-20T11:26:21.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 855005 9.98 MB/sec execute 310 sec latency 28.241 ms 2020-11-20T11:26:22.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 856215 9.97 MB/sec execute 311 sec latency 22.964 ms 2020-11-20T11:26:23.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 858121 9.96 MB/sec execute 312 sec latency 20.585 ms 2020-11-20T11:26:24.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 859886 9.97 MB/sec execute 313 sec latency 14.027 ms 2020-11-20T11:26:25.880 INFO:tasks.workunit.client.0.smithi112.stdout: 1 862078 9.97 MB/sec execute 314 sec latency 17.971 ms 2020-11-20T11:26:26.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 863426 9.96 MB/sec execute 315 sec latency 44.680 ms 2020-11-20T11:26:27.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 865340 9.96 MB/sec execute 316 sec latency 20.336 ms 2020-11-20T11:26:28.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 867025 9.96 MB/sec execute 317 sec latency 14.810 ms 2020-11-20T11:26:29.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 869059 9.96 MB/sec execute 318 sec latency 23.813 ms 2020-11-20T11:26:30.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 870600 9.96 MB/sec execute 319 sec latency 14.928 ms 2020-11-20T11:26:31.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 872279 9.95 MB/sec execute 320 sec latency 84.037 ms 2020-11-20T11:26:32.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 873757 9.95 MB/sec execute 321 sec latency 17.163 ms 2020-11-20T11:26:33.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 874890 9.94 MB/sec execute 322 sec latency 22.392 ms 2020-11-20T11:26:34.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 876936 9.95 MB/sec execute 323 sec latency 18.556 ms 2020-11-20T11:26:35.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 877841 9.92 MB/sec execute 324 sec latency 16.513 ms 2020-11-20T11:26:36.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 879846 9.93 MB/sec execute 325 sec latency 21.945 ms 2020-11-20T11:26:37.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 881073 9.92 MB/sec execute 326 sec latency 43.788 ms 2020-11-20T11:26:38.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 882726 9.91 MB/sec execute 327 sec latency 25.470 ms 2020-11-20T11:26:39.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 884289 9.92 MB/sec execute 328 sec latency 16.404 ms 2020-11-20T11:26:40.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 885452 9.90 MB/sec execute 329 sec latency 16.721 ms 2020-11-20T11:26:41.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 887636 9.91 MB/sec execute 330 sec latency 31.389 ms 2020-11-20T11:26:42.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 888635 9.89 MB/sec execute 331 sec latency 15.525 ms 2020-11-20T11:26:43.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 890578 9.89 MB/sec execute 332 sec latency 62.718 ms 2020-11-20T11:26:44.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 891917 9.88 MB/sec execute 333 sec latency 15.311 ms 2020-11-20T11:26:45.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 894081 9.89 MB/sec execute 334 sec latency 21.364 ms 2020-11-20T11:26:46.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 895391 9.88 MB/sec execute 335 sec latency 16.119 ms 2020-11-20T11:26:47.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 897253 9.88 MB/sec execute 336 sec latency 23.758 ms 2020-11-20T11:26:48.881 INFO:tasks.workunit.client.0.smithi112.stdout: 1 898677 9.88 MB/sec execute 337 sec latency 42.614 ms 2020-11-20T11:26:49.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 899894 9.87 MB/sec execute 338 sec latency 34.956 ms 2020-11-20T11:26:50.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 901862 9.87 MB/sec execute 339 sec latency 23.753 ms 2020-11-20T11:26:51.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 902738 9.85 MB/sec execute 340 sec latency 29.254 ms 2020-11-20T11:26:52.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 904679 9.86 MB/sec execute 341 sec latency 29.120 ms 2020-11-20T11:26:53.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 905957 9.85 MB/sec execute 342 sec latency 36.714 ms 2020-11-20T11:26:54.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 906426 9.82 MB/sec execute 343 sec latency 149.497 ms 2020-11-20T11:26:55.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 906478 9.80 MB/sec execute 344 sec latency 612.632 ms 2020-11-20T11:26:56.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 908191 9.80 MB/sec execute 345 sec latency 49.070 ms 2020-11-20T11:26:57.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 909115 9.79 MB/sec execute 346 sec latency 40.455 ms 2020-11-20T11:26:58.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 909664 9.76 MB/sec execute 347 sec latency 29.803 ms 2020-11-20T11:26:59.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 911715 9.76 MB/sec execute 348 sec latency 26.760 ms 2020-11-20T11:27:00.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 912979 9.76 MB/sec execute 349 sec latency 15.913 ms 2020-11-20T11:27:01.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 914361 9.75 MB/sec execute 350 sec latency 28.931 ms 2020-11-20T11:27:02.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 916091 9.75 MB/sec execute 351 sec latency 53.119 ms 2020-11-20T11:27:03.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 916959 9.76 MB/sec execute 352 sec latency 44.828 ms 2020-11-20T11:27:04.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 918211 9.78 MB/sec execute 353 sec latency 21.232 ms 2020-11-20T11:27:05.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 920040 9.78 MB/sec execute 354 sec latency 43.168 ms 2020-11-20T11:27:06.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 921131 9.76 MB/sec execute 355 sec latency 15.808 ms 2020-11-20T11:27:07.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 923615 9.77 MB/sec execute 356 sec latency 66.453 ms 2020-11-20T11:27:08.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 925200 9.77 MB/sec execute 357 sec latency 13.546 ms 2020-11-20T11:27:10.459 INFO:tasks.workunit.client.0.smithi112.stdout: 1 927582 9.79 MB/sec execute 358 sec latency 65.481 ms 2020-11-20T11:27:10.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 927783 9.76 MB/sec execute 359 sec latency 212.258 ms 2020-11-20T11:27:11.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 929029 9.75 MB/sec execute 360 sec latency 39.708 ms 2020-11-20T11:27:12.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 931247 9.76 MB/sec execute 361 sec latency 17.487 ms 2020-11-20T11:27:13.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 932389 9.75 MB/sec execute 362 sec latency 38.490 ms 2020-11-20T11:27:14.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 934731 9.76 MB/sec execute 363 sec latency 14.357 ms 2020-11-20T11:27:15.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 936091 9.74 MB/sec execute 364 sec latency 37.287 ms 2020-11-20T11:27:16.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 938341 9.76 MB/sec execute 365 sec latency 20.159 ms 2020-11-20T11:27:17.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 939902 9.74 MB/sec execute 366 sec latency 25.982 ms 2020-11-20T11:27:18.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 941978 9.75 MB/sec execute 367 sec latency 15.742 ms 2020-11-20T11:27:19.882 INFO:tasks.workunit.client.0.smithi112.stdout: 1 943898 9.75 MB/sec execute 368 sec latency 28.614 ms 2020-11-20T11:27:20.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 945648 9.75 MB/sec execute 369 sec latency 15.430 ms 2020-11-20T11:27:21.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 946999 9.74 MB/sec execute 370 sec latency 63.045 ms 2020-11-20T11:27:22.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 948937 9.75 MB/sec execute 371 sec latency 17.172 ms 2020-11-20T11:27:23.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 950211 9.74 MB/sec execute 372 sec latency 17.601 ms 2020-11-20T11:27:24.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 952314 9.75 MB/sec execute 373 sec latency 25.001 ms 2020-11-20T11:27:25.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 953265 9.73 MB/sec execute 374 sec latency 15.186 ms 2020-11-20T11:27:26.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 955382 9.74 MB/sec execute 375 sec latency 34.201 ms 2020-11-20T11:27:27.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 956465 9.73 MB/sec execute 376 sec latency 58.613 ms 2020-11-20T11:27:28.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 958304 9.72 MB/sec execute 377 sec latency 17.345 ms 2020-11-20T11:27:29.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 959847 9.72 MB/sec execute 378 sec latency 15.402 ms 2020-11-20T11:27:30.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 961348 9.71 MB/sec execute 379 sec latency 24.257 ms 2020-11-20T11:27:31.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 963112 9.72 MB/sec execute 380 sec latency 22.791 ms 2020-11-20T11:27:32.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 963933 9.70 MB/sec execute 381 sec latency 94.721 ms 2020-11-20T11:27:33.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 966159 9.71 MB/sec execute 382 sec latency 53.483 ms 2020-11-20T11:27:34.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 967320 9.70 MB/sec execute 383 sec latency 14.734 ms 2020-11-20T11:27:35.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 968796 9.69 MB/sec execute 384 sec latency 386.128 ms 2020-11-20T11:27:36.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 969551 9.68 MB/sec execute 385 sec latency 705.873 ms 2020-11-20T11:27:37.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 970591 9.67 MB/sec execute 386 sec latency 20.656 ms 2020-11-20T11:27:38.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 971700 9.66 MB/sec execute 387 sec latency 24.070 ms 2020-11-20T11:27:39.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 973796 9.67 MB/sec execute 388 sec latency 16.528 ms 2020-11-20T11:27:40.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 975294 9.66 MB/sec execute 389 sec latency 30.773 ms 2020-11-20T11:27:41.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 977439 9.67 MB/sec execute 390 sec latency 14.913 ms 2020-11-20T11:27:42.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 979419 9.66 MB/sec execute 391 sec latency 15.993 ms 2020-11-20T11:27:43.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 981097 9.67 MB/sec execute 392 sec latency 58.397 ms 2020-11-20T11:27:44.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 982983 9.66 MB/sec execute 393 sec latency 22.688 ms 2020-11-20T11:27:46.380 INFO:tasks.workunit.client.0.smithi112.stdout: 1 984785 9.67 MB/sec execute 394 sec latency 13.979 ms 2020-11-20T11:27:46.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 986689 9.66 MB/sec execute 395 sec latency 20.573 ms 2020-11-20T11:27:47.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 988336 9.67 MB/sec execute 396 sec latency 14.802 ms 2020-11-20T11:27:48.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 990163 9.66 MB/sec execute 397 sec latency 21.638 ms 2020-11-20T11:27:49.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 991663 9.67 MB/sec execute 398 sec latency 61.482 ms 2020-11-20T11:27:50.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 993431 9.66 MB/sec execute 399 sec latency 25.641 ms 2020-11-20T11:27:51.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 995145 9.67 MB/sec execute 400 sec latency 20.856 ms 2020-11-20T11:27:52.883 INFO:tasks.workunit.client.0.smithi112.stdout: 1 996414 9.66 MB/sec execute 401 sec latency 21.776 ms 2020-11-20T11:27:53.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 998574 9.67 MB/sec execute 402 sec latency 16.227 ms 2020-11-20T11:27:54.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 999431 9.65 MB/sec execute 403 sec latency 75.881 ms 2020-11-20T11:27:55.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1001692 9.65 MB/sec execute 404 sec latency 20.130 ms 2020-11-20T11:27:56.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1002082 9.64 MB/sec execute 405 sec latency 574.683 ms 2020-11-20T11:27:57.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1002844 9.62 MB/sec execute 406 sec latency 27.702 ms 2020-11-20T11:27:58.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1004472 9.61 MB/sec execute 407 sec latency 29.519 ms 2020-11-20T11:27:59.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1005817 9.62 MB/sec execute 408 sec latency 127.190 ms 2020-11-20T11:28:00.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1007190 9.61 MB/sec execute 409 sec latency 25.554 ms 2020-11-20T11:28:01.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1009194 9.62 MB/sec execute 410 sec latency 27.354 ms 2020-11-20T11:28:02.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1010141 9.60 MB/sec execute 411 sec latency 25.721 ms 2020-11-20T11:28:03.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1012449 9.61 MB/sec execute 412 sec latency 16.717 ms 2020-11-20T11:28:04.389 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:04.409 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:04.411 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:04.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1013391 9.60 MB/sec execute 413 sec latency 18.087 ms 2020-11-20T11:28:05.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1015112 9.59 MB/sec execute 414 sec latency 98.801 ms 2020-11-20T11:28:06.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1016521 9.59 MB/sec execute 415 sec latency 16.954 ms 2020-11-20T11:28:07.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1017892 9.58 MB/sec execute 416 sec latency 26.684 ms 2020-11-20T11:28:08.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1019828 9.59 MB/sec execute 417 sec latency 21.120 ms 2020-11-20T11:28:09.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1020819 9.58 MB/sec execute 418 sec latency 16.548 ms 2020-11-20T11:28:10.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1022923 9.58 MB/sec execute 419 sec latency 26.423 ms 2020-11-20T11:28:11.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1023871 9.57 MB/sec execute 420 sec latency 41.175 ms 2020-11-20T11:28:12.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1025636 9.57 MB/sec execute 421 sec latency 26.887 ms 2020-11-20T11:28:13.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1027151 9.57 MB/sec execute 422 sec latency 19.976 ms 2020-11-20T11:28:14.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1028779 9.56 MB/sec execute 423 sec latency 23.431 ms 2020-11-20T11:28:15.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1030539 9.57 MB/sec execute 424 sec latency 16.236 ms 2020-11-20T11:28:16.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1031483 9.55 MB/sec execute 425 sec latency 48.131 ms 2020-11-20T11:28:17.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1033740 9.57 MB/sec execute 426 sec latency 18.882 ms 2020-11-20T11:28:18.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1034685 9.55 MB/sec execute 427 sec latency 16.700 ms 2020-11-20T11:28:19.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1036694 9.56 MB/sec execute 428 sec latency 43.494 ms 2020-11-20T11:28:20.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1038003 9.55 MB/sec execute 429 sec latency 15.855 ms 2020-11-20T11:28:21.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1038757 9.54 MB/sec execute 430 sec latency 233.115 ms 2020-11-20T11:28:22.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1039738 9.52 MB/sec execute 431 sec latency 189.494 ms 2020-11-20T11:28:23.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1041077 9.53 MB/sec execute 432 sec latency 26.937 ms 2020-11-20T11:28:24.884 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1041794 9.51 MB/sec execute 433 sec latency 19.931 ms 2020-11-20T11:28:25.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1043805 9.51 MB/sec execute 434 sec latency 22.048 ms 2020-11-20T11:28:26.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1045103 9.51 MB/sec execute 435 sec latency 16.969 ms 2020-11-20T11:28:27.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1046784 9.50 MB/sec execute 436 sec latency 44.972 ms 2020-11-20T11:28:28.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1048285 9.50 MB/sec execute 437 sec latency 19.392 ms 2020-11-20T11:28:29.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1049374 9.49 MB/sec execute 438 sec latency 22.479 ms 2020-11-20T11:28:30.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1051505 9.50 MB/sec execute 439 sec latency 17.545 ms 2020-11-20T11:28:31.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1052432 9.49 MB/sec execute 440 sec latency 16.127 ms 2020-11-20T11:28:32.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1054807 9.49 MB/sec execute 441 sec latency 31.846 ms 2020-11-20T11:28:33.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1055861 9.49 MB/sec execute 442 sec latency 67.434 ms 2020-11-20T11:28:34.634 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:34.638 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:34.641 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:28:34.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1058258 9.49 MB/sec execute 443 sec latency 15.084 ms 2020-11-20T11:28:35.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1059523 9.49 MB/sec execute 444 sec latency 25.138 ms 2020-11-20T11:28:36.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061595 9.49 MB/sec execute 445 sec latency 65.929 ms 2020-11-20T11:28:37.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061595 9.47 MB/sec execute 446 sec latency 1047.040 ms 2020-11-20T11:28:38.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061595 9.45 MB/sec execute 447 sec latency 2047.132 ms 2020-11-20T11:28:39.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061595 9.43 MB/sec execute 448 sec latency 3047.202 ms 2020-11-20T11:28:40.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061595 9.41 MB/sec execute 449 sec latency 4047.308 ms 2020-11-20T11:28:41.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1061792 9.39 MB/sec execute 450 sec latency 4908.183 ms 2020-11-20T11:28:42.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1062937 9.38 MB/sec execute 451 sec latency 30.872 ms 2020-11-20T11:28:43.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1064484 9.37 MB/sec execute 452 sec latency 53.100 ms 2020-11-20T11:28:44.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1066053 9.38 MB/sec execute 453 sec latency 15.708 ms 2020-11-20T11:28:45.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1067141 9.37 MB/sec execute 454 sec latency 33.273 ms 2020-11-20T11:28:46.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1069375 9.38 MB/sec execute 455 sec latency 16.059 ms 2020-11-20T11:28:47.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1070417 9.37 MB/sec execute 456 sec latency 16.437 ms 2020-11-20T11:28:48.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1072572 9.37 MB/sec execute 457 sec latency 24.350 ms 2020-11-20T11:28:49.885 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1073586 9.36 MB/sec execute 458 sec latency 46.527 ms 2020-11-20T11:28:50.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1075540 9.37 MB/sec execute 459 sec latency 33.367 ms 2020-11-20T11:28:51.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1076910 9.36 MB/sec execute 460 sec latency 24.970 ms 2020-11-20T11:28:52.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1078674 9.36 MB/sec execute 461 sec latency 21.081 ms 2020-11-20T11:28:53.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1080193 9.36 MB/sec execute 462 sec latency 18.173 ms 2020-11-20T11:28:54.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1081122 9.35 MB/sec execute 463 sec latency 28.499 ms 2020-11-20T11:28:55.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1083064 9.35 MB/sec execute 464 sec latency 62.973 ms 2020-11-20T11:28:56.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1084165 9.34 MB/sec execute 465 sec latency 16.607 ms 2020-11-20T11:28:57.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1084908 9.33 MB/sec execute 466 sec latency 200.903 ms 2020-11-20T11:28:58.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1086593 9.33 MB/sec execute 467 sec latency 44.291 ms 2020-11-20T11:28:59.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1087497 9.32 MB/sec execute 468 sec latency 21.194 ms 2020-11-20T11:29:00.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1089102 9.32 MB/sec execute 469 sec latency 39.241 ms 2020-11-20T11:29:01.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1090756 9.33 MB/sec execute 470 sec latency 24.957 ms 2020-11-20T11:29:02.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1091583 9.31 MB/sec execute 471 sec latency 28.274 ms 2020-11-20T11:29:03.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1093704 9.31 MB/sec execute 472 sec latency 19.743 ms 2020-11-20T11:29:04.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1094795 9.31 MB/sec execute 473 sec latency 17.228 ms 2020-11-20T11:29:05.057 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:05.061 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:05.069 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:05.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1096489 9.30 MB/sec execute 474 sec latency 42.611 ms 2020-11-20T11:29:06.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1097981 9.31 MB/sec execute 475 sec latency 17.688 ms 2020-11-20T11:29:07.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1099088 9.30 MB/sec execute 476 sec latency 23.329 ms 2020-11-20T11:29:08.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1101217 9.31 MB/sec execute 477 sec latency 16.979 ms 2020-11-20T11:29:09.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1102067 9.29 MB/sec execute 478 sec latency 18.860 ms 2020-11-20T11:29:10.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1104037 9.30 MB/sec execute 479 sec latency 26.459 ms 2020-11-20T11:29:11.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1105116 9.29 MB/sec execute 480 sec latency 58.945 ms 2020-11-20T11:29:12.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1106362 9.28 MB/sec execute 481 sec latency 27.450 ms 2020-11-20T11:29:13.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1108447 9.29 MB/sec execute 482 sec latency 19.906 ms 2020-11-20T11:29:14.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1109224 9.27 MB/sec execute 483 sec latency 53.202 ms 2020-11-20T11:29:15.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1111167 9.28 MB/sec execute 484 sec latency 43.505 ms 2020-11-20T11:29:16.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1112466 9.27 MB/sec execute 485 sec latency 20.111 ms 2020-11-20T11:29:17.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1113560 9.27 MB/sec execute 486 sec latency 46.203 ms 2020-11-20T11:29:18.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1114251 9.25 MB/sec execute 487 sec latency 238.898 ms 2020-11-20T11:29:19.886 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1115605 9.26 MB/sec execute 488 sec latency 36.248 ms 2020-11-20T11:29:20.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1116306 9.24 MB/sec execute 489 sec latency 21.669 ms 2020-11-20T11:29:21.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1118220 9.24 MB/sec execute 490 sec latency 38.177 ms 2020-11-20T11:29:22.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1119329 9.24 MB/sec execute 491 sec latency 38.534 ms 2020-11-20T11:29:23.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1120578 9.23 MB/sec execute 492 sec latency 26.581 ms 2020-11-20T11:29:24.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1122564 9.24 MB/sec execute 493 sec latency 19.821 ms 2020-11-20T11:29:25.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1123396 9.22 MB/sec execute 494 sec latency 43.207 ms 2020-11-20T11:29:26.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1125315 9.23 MB/sec execute 495 sec latency 27.088 ms 2020-11-20T11:29:27.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1126546 9.22 MB/sec execute 496 sec latency 18.306 ms 2020-11-20T11:29:28.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1127661 9.21 MB/sec execute 497 sec latency 60.464 ms 2020-11-20T11:29:29.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1129648 9.22 MB/sec execute 498 sec latency 18.936 ms 2020-11-20T11:29:30.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1130480 9.21 MB/sec execute 499 sec latency 18.914 ms 2020-11-20T11:29:31.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1132440 9.21 MB/sec execute 500 sec latency 37.612 ms 2020-11-20T11:29:32.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1133792 9.21 MB/sec execute 501 sec latency 16.058 ms 2020-11-20T11:29:33.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1135512 9.20 MB/sec execute 502 sec latency 23.026 ms 2020-11-20T11:29:34.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1136980 9.21 MB/sec execute 503 sec latency 50.366 ms 2020-11-20T11:29:35.129 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:35.131 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:35.134 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:29:35.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1137832 9.19 MB/sec execute 504 sec latency 84.813 ms 2020-11-20T11:29:36.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1140015 9.20 MB/sec execute 505 sec latency 16.947 ms 2020-11-20T11:29:37.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1141075 9.19 MB/sec execute 506 sec latency 15.922 ms 2020-11-20T11:29:38.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1141850 9.18 MB/sec execute 507 sec latency 412.056 ms 2020-11-20T11:29:39.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1143214 9.18 MB/sec execute 508 sec latency 183.895 ms 2020-11-20T11:29:40.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1144170 9.17 MB/sec execute 509 sec latency 19.522 ms 2020-11-20T11:29:41.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1145250 9.17 MB/sec execute 510 sec latency 39.334 ms 2020-11-20T11:29:42.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1147367 9.17 MB/sec execute 511 sec latency 16.947 ms 2020-11-20T11:29:43.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1148271 9.16 MB/sec execute 512 sec latency 17.352 ms 2020-11-20T11:29:44.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1150213 9.17 MB/sec execute 513 sec latency 68.901 ms 2020-11-20T11:29:45.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1151512 9.16 MB/sec execute 514 sec latency 27.111 ms 2020-11-20T11:29:46.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1153182 9.16 MB/sec execute 515 sec latency 22.986 ms 2020-11-20T11:29:47.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1154685 9.16 MB/sec execute 516 sec latency 17.625 ms 2020-11-20T11:29:48.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1155635 9.15 MB/sec execute 517 sec latency 24.006 ms 2020-11-20T11:29:49.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1157758 9.15 MB/sec execute 518 sec latency 18.134 ms 2020-11-20T11:29:50.887 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1158727 9.15 MB/sec execute 519 sec latency 61.754 ms 2020-11-20T11:29:51.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1160425 9.14 MB/sec execute 520 sec latency 34.062 ms 2020-11-20T11:29:52.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1161936 9.15 MB/sec execute 521 sec latency 16.638 ms 2020-11-20T11:29:53.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1163285 9.14 MB/sec execute 522 sec latency 24.543 ms 2020-11-20T11:29:54.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1165261 9.15 MB/sec execute 523 sec latency 16.268 ms 2020-11-20T11:29:55.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1166172 9.14 MB/sec execute 524 sec latency 21.170 ms 2020-11-20T11:29:56.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1168211 9.14 MB/sec execute 525 sec latency 44.927 ms 2020-11-20T11:29:57.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1169368 9.13 MB/sec execute 526 sec latency 17.495 ms 2020-11-20T11:29:58.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1171171 9.13 MB/sec execute 527 sec latency 18.207 ms 2020-11-20T11:29:59.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1172679 9.13 MB/sec execute 528 sec latency 16.418 ms 2020-11-20T11:30:00.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1174087 9.13 MB/sec execute 529 sec latency 21.044 ms 2020-11-20T11:30:01.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1175800 9.13 MB/sec execute 530 sec latency 55.416 ms 2020-11-20T11:30:02.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1176716 9.12 MB/sec execute 531 sec latency 19.985 ms 2020-11-20T11:30:03.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1178648 9.13 MB/sec execute 532 sec latency 26.891 ms 2020-11-20T11:30:04.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1179889 9.12 MB/sec execute 533 sec latency 16.421 ms 2020-11-20T11:30:05.579 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:05.581 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:05.584 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:30:05.877 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-20T11:30:05.873+0000 7f82ede36700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25823) UID: 0 2020-11-20T11:30:07.425 INFO:tasks.ceph.osd.4.smithi166.stderr:2020-11-20T11:30:05.873+0000 7f563675e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25823) UID: 0 2020-11-20T11:30:07.426 INFO:tasks.ceph.osd.7.smithi166.stderr:2020-11-20T11:30:05.873+0000 7feae7a06700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25823) UID: 0 2020-11-20T11:30:07.426 INFO:tasks.ceph.osd.10.smithi166.stderr:2020-11-20T11:30:05.873+0000 7f9b10bf0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25823) UID: 0 2020-11-20T11:30:07.427 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1181569 9.12 MB/sec execute 534 sec latency 18.911 ms 2020-11-20T11:30:07.427 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1182890 9.12 MB/sec execute 535 sec latency 51.589 ms 2020-11-20T11:30:07.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1182993 9.10 MB/sec execute 536 sec latency 293.967 ms 2020-11-20T11:30:08.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1183549 9.09 MB/sec execute 537 sec latency 26.566 ms 2020-11-20T11:30:09.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1184727 9.08 MB/sec execute 538 sec latency 34.009 ms 2020-11-20T11:30:10.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1186297 9.09 MB/sec execute 539 sec latency 48.403 ms 2020-11-20T11:30:11.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1187158 9.07 MB/sec execute 540 sec latency 27.477 ms 2020-11-20T11:30:12.889 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1188852 9.07 MB/sec execute 541 sec latency 59.489 ms 2020-11-20T11:30:13.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1190258 9.07 MB/sec execute 542 sec latency 16.956 ms 2020-11-20T11:30:14.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1191448 9.07 MB/sec execute 543 sec latency 25.507 ms 2020-11-20T11:30:15.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1193490 9.07 MB/sec execute 544 sec latency 17.895 ms 2020-11-20T11:30:16.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1194265 9.06 MB/sec execute 545 sec latency 68.061 ms 2020-11-20T11:30:17.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1196159 9.06 MB/sec execute 546 sec latency 25.973 ms 2020-11-20T11:30:18.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1197530 9.06 MB/sec execute 547 sec latency 50.327 ms 2020-11-20T11:30:19.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1199378 9.06 MB/sec execute 548 sec latency 19.475 ms 2020-11-20T11:30:20.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1201022 9.06 MB/sec execute 549 sec latency 48.219 ms 2020-11-20T11:30:21.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1202820 9.06 MB/sec execute 550 sec latency 29.253 ms 2020-11-20T11:30:22.888 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1204393 9.07 MB/sec execute 551 sec latency 64.094 ms 2020-11-20T11:30:23.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1204833 9.05 MB/sec execute 552 sec latency 376.148 ms 2020-11-20T11:30:24.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1206367 9.05 MB/sec execute 553 sec latency 102.781 ms 2020-11-20T11:30:25.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1207786 9.05 MB/sec execute 554 sec latency 36.802 ms 2020-11-20T11:30:26.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1208795 9.04 MB/sec execute 555 sec latency 28.032 ms 2020-11-20T11:30:27.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1211336 9.05 MB/sec execute 556 sec latency 15.310 ms 2020-11-20T11:30:28.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1212276 9.04 MB/sec execute 557 sec latency 23.283 ms 2020-11-20T11:30:29.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1214833 9.05 MB/sec execute 558 sec latency 14.453 ms 2020-11-20T11:30:30.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1215893 9.04 MB/sec execute 559 sec latency 22.826 ms 2020-11-20T11:30:31.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1218419 9.06 MB/sec execute 560 sec latency 15.746 ms 2020-11-20T11:30:32.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1219346 9.04 MB/sec execute 561 sec latency 28.104 ms 2020-11-20T11:30:33.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1221862 9.06 MB/sec execute 562 sec latency 16.280 ms 2020-11-20T11:30:34.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1222677 9.04 MB/sec execute 563 sec latency 75.753 ms 2020-11-20T11:30:35.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1225109 9.05 MB/sec execute 564 sec latency 16.994 ms 2020-11-20T11:30:36.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1226227 9.05 MB/sec execute 565 sec latency 16.556 ms 2020-11-20T11:30:37.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1228496 9.05 MB/sec execute 566 sec latency 23.376 ms 2020-11-20T11:30:38.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1229727 9.05 MB/sec execute 567 sec latency 16.460 ms 2020-11-20T11:30:39.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1232045 9.05 MB/sec execute 568 sec latency 18.042 ms 2020-11-20T11:30:40.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1233078 9.05 MB/sec execute 569 sec latency 59.416 ms 2020-11-20T11:30:41.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1234871 9.05 MB/sec execute 570 sec latency 22.258 ms 2020-11-20T11:30:42.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1236593 9.05 MB/sec execute 571 sec latency 18.008 ms 2020-11-20T11:30:43.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1238329 9.05 MB/sec execute 572 sec latency 21.294 ms 2020-11-20T11:30:44.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1239862 9.05 MB/sec execute 573 sec latency 19.626 ms 2020-11-20T11:30:45.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1240734 9.04 MB/sec execute 574 sec latency 64.531 ms 2020-11-20T11:30:46.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1242851 9.04 MB/sec execute 575 sec latency 19.499 ms 2020-11-20T11:30:47.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1243899 9.04 MB/sec execute 576 sec latency 17.401 ms 2020-11-20T11:30:48.893 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1245919 9.04 MB/sec execute 577 sec latency 23.564 ms 2020-11-20T11:30:49.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1247170 9.04 MB/sec execute 578 sec latency 19.301 ms 2020-11-20T11:30:50.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1248552 9.03 MB/sec execute 579 sec latency 53.481 ms 2020-11-20T11:30:51.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1250357 9.04 MB/sec execute 580 sec latency 24.297 ms 2020-11-20T11:30:52.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1251040 9.03 MB/sec execute 581 sec latency 52.570 ms 2020-11-20T11:30:53.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1253109 9.03 MB/sec execute 582 sec latency 20.429 ms 2020-11-20T11:30:54.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1253492 9.02 MB/sec execute 583 sec latency 241.851 ms 2020-11-20T11:30:55.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1253940 9.01 MB/sec execute 584 sec latency 156.240 ms 2020-11-20T11:30:56.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1254474 9.00 MB/sec execute 585 sec latency 31.925 ms 2020-11-20T11:30:57.895 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1255962 8.99 MB/sec execute 586 sec latency 33.563 ms 2020-11-20T11:30:58.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1257279 9.00 MB/sec execute 587 sec latency 38.859 ms 2020-11-20T11:30:59.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1258119 8.98 MB/sec execute 588 sec latency 21.469 ms 2020-11-20T11:31:00.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1259958 8.99 MB/sec execute 589 sec latency 30.169 ms 2020-11-20T11:31:01.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1261210 8.98 MB/sec execute 590 sec latency 33.658 ms 2020-11-20T11:31:02.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1262248 8.98 MB/sec execute 591 sec latency 54.623 ms 2020-11-20T11:31:03.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1264392 8.98 MB/sec execute 592 sec latency 17.420 ms 2020-11-20T11:31:04.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1265288 8.97 MB/sec execute 593 sec latency 17.535 ms 2020-11-20T11:31:05.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1267277 8.98 MB/sec execute 594 sec latency 29.851 ms 2020-11-20T11:31:06.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1268567 8.97 MB/sec execute 595 sec latency 17.050 ms 2020-11-20T11:31:07.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1270193 8.97 MB/sec execute 596 sec latency 34.857 ms 2020-11-20T11:31:08.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1271751 8.98 MB/sec execute 597 sec latency 17.566 ms 2020-11-20T11:31:09.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1272773 8.97 MB/sec execute 598 sec latency 26.976 ms 2020-11-20T11:31:10.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 1274944 8.97 MB/sec execute 599 sec latency 18.127 ms 2020-11-20T11:31:11.894 INFO:tasks.workunit.client.0.smithi112.stdout: 1 cleanup 600 sec 2020-11-20T11:31:12.035 INFO:tasks.workunit.client.0.smithi112.stdout: 0 cleanup 600 sec 2020-11-20T11:31:12.035 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:31:12.036 INFO:tasks.workunit.client.0.smithi112.stdout: Operation Count AvgLat MaxLat 2020-11-20T11:31:12.036 INFO:tasks.workunit.client.0.smithi112.stdout: ---------------------------------------- 2020-11-20T11:31:12.036 INFO:tasks.workunit.client.0.smithi112.stdout: NTCreateX 171421 1.121 343.953 2020-11-20T11:31:12.036 INFO:tasks.workunit.client.0.smithi112.stdout: Close 125910 0.002 1.089 2020-11-20T11:31:12.037 INFO:tasks.workunit.client.0.smithi112.stdout: Rename 7259 5.823 612.622 2020-11-20T11:31:12.037 INFO:tasks.workunit.client.0.smithi112.stdout: Unlink 34643 1.397 218.181 2020-11-20T11:31:12.037 INFO:tasks.workunit.client.0.smithi112.stdout: Deltree 4 55.259 64.511 2020-11-20T11:31:12.037 INFO:tasks.workunit.client.0.smithi112.stdout: Mkdir 2 0.006 0.008 2020-11-20T11:31:12.037 INFO:tasks.workunit.client.0.smithi112.stdout: Qpathinfo 155387 1.015 506.866 2020-11-20T11:31:12.038 INFO:tasks.workunit.client.0.smithi112.stdout: Qfileinfo 27215 0.001 0.023 2020-11-20T11:31:12.038 INFO:tasks.workunit.client.0.smithi112.stdout: Qfsinfo 28496 0.238 13.046 2020-11-20T11:31:12.038 INFO:tasks.workunit.client.0.smithi112.stdout: Sfileinfo 13971 0.016 6.035 2020-11-20T11:31:12.038 INFO:tasks.workunit.client.0.smithi112.stdout: Find 60080 0.095 116.380 2020-11-20T11:31:12.038 INFO:tasks.workunit.client.0.smithi112.stdout: WriteX 85408 0.027 574.676 2020-11-20T11:31:12.039 INFO:tasks.workunit.client.0.smithi112.stdout: ReadX 268680 0.022 38.483 2020-11-20T11:31:12.039 INFO:tasks.workunit.client.0.smithi112.stdout: LockX 558 0.890 22.520 2020-11-20T11:31:12.039 INFO:tasks.workunit.client.0.smithi112.stdout: UnlockX 558 0.688 4.468 2020-11-20T11:31:12.039 INFO:tasks.workunit.client.0.smithi112.stdout: Flush 12030 11.260 4908.176 2020-11-20T11:31:12.039 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:31:12.040 INFO:tasks.workunit.client.0.smithi112.stdout:Throughput 8.97462 MB/sec 1 clients 1 procs max_latency=4908.183 ms 2020-11-20T11:31:12.081 INFO:tasks.workunit.client.0.smithi112.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T11:31:12.082 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:31:12.082 INFO:tasks.workunit.client.0.smithi112.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T11:31:12.083 INFO:tasks.workunit.client.0.smithi112.stdout:8 of 10 processes prepared for launch 0 sec 2020-11-20T11:31:12.183 INFO:tasks.workunit.client.0.smithi112.stdout:10 of 10 processes prepared for launch 0 sec 2020-11-20T11:31:12.183 INFO:tasks.workunit.client.0.smithi112.stdout:releasing clients 2020-11-20T11:31:13.183 INFO:tasks.workunit.client.0.smithi112.stdout: 10 311 114.06 MB/sec warmup 1 sec latency 123.566 ms 2020-11-20T11:31:14.183 INFO:tasks.workunit.client.0.smithi112.stdout: 10 673 105.72 MB/sec warmup 2 sec latency 61.384 ms 2020-11-20T11:31:15.183 INFO:tasks.workunit.client.0.smithi112.stdout: 10 735 71.10 MB/sec warmup 3 sec latency 639.719 ms 2020-11-20T11:31:16.183 INFO:tasks.workunit.client.0.smithi112.stdout: 10 748 53.36 MB/sec warmup 4 sec latency 1586.777 ms 2020-11-20T11:31:17.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 897 43.34 MB/sec warmup 5 sec latency 1835.099 ms 2020-11-20T11:31:18.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 1233 39.35 MB/sec warmup 6 sec latency 136.035 ms 2020-11-20T11:31:19.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 1828 37.62 MB/sec warmup 7 sec latency 80.858 ms 2020-11-20T11:31:20.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 2456 35.37 MB/sec warmup 8 sec latency 75.312 ms 2020-11-20T11:31:21.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 2998 37.29 MB/sec warmup 9 sec latency 50.040 ms 2020-11-20T11:31:22.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 3297 35.13 MB/sec warmup 10 sec latency 222.253 ms 2020-11-20T11:31:23.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 3711 35.57 MB/sec warmup 11 sec latency 159.519 ms 2020-11-20T11:31:24.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 3870 33.20 MB/sec warmup 12 sec latency 94.484 ms 2020-11-20T11:31:25.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 3996 30.81 MB/sec warmup 13 sec latency 97.298 ms 2020-11-20T11:31:26.187 INFO:tasks.workunit.client.0.smithi112.stdout: 10 4217 28.71 MB/sec warmup 14 sec latency 50.122 ms 2020-11-20T11:31:27.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 4425 27.18 MB/sec warmup 15 sec latency 89.050 ms 2020-11-20T11:31:28.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 4756 26.51 MB/sec warmup 16 sec latency 107.146 ms 2020-11-20T11:31:29.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 5351 26.79 MB/sec warmup 17 sec latency 51.468 ms 2020-11-20T11:31:30.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 6027 26.55 MB/sec warmup 18 sec latency 90.405 ms 2020-11-20T11:31:31.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 6545 27.80 MB/sec warmup 19 sec latency 48.485 ms 2020-11-20T11:31:32.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 6976 27.77 MB/sec warmup 20 sec latency 91.607 ms 2020-11-20T11:31:33.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7265 27.69 MB/sec warmup 21 sec latency 77.206 ms 2020-11-20T11:31:34.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7445 26.80 MB/sec warmup 22 sec latency 56.951 ms 2020-11-20T11:31:35.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7563 25.75 MB/sec warmup 23 sec latency 171.352 ms 2020-11-20T11:31:36.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7574 24.67 MB/sec warmup 24 sec latency 1155.554 ms 2020-11-20T11:31:37.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7578 23.69 MB/sec warmup 25 sec latency 1300.276 ms 2020-11-20T11:31:38.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7716 22.85 MB/sec warmup 26 sec latency 655.310 ms 2020-11-20T11:31:39.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7854 22.07 MB/sec warmup 27 sec latency 110.757 ms 2020-11-20T11:31:40.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 7969 21.47 MB/sec warmup 28 sec latency 199.724 ms 2020-11-20T11:31:41.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 8135 20.91 MB/sec warmup 29 sec latency 151.343 ms 2020-11-20T11:31:42.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 8348 20.53 MB/sec warmup 30 sec latency 210.403 ms 2020-11-20T11:31:43.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 8646 20.52 MB/sec warmup 31 sec latency 205.595 ms 2020-11-20T11:31:44.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 9227 20.53 MB/sec warmup 32 sec latency 91.029 ms 2020-11-20T11:31:45.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 9772 20.75 MB/sec warmup 33 sec latency 50.220 ms 2020-11-20T11:31:46.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 10237 21.41 MB/sec warmup 34 sec latency 65.976 ms 2020-11-20T11:31:47.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 10664 21.66 MB/sec warmup 35 sec latency 89.396 ms 2020-11-20T11:31:48.190 INFO:tasks.workunit.client.0.smithi112.stdout: 10 10926 21.62 MB/sec warmup 36 sec latency 86.333 ms 2020-11-20T11:31:49.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11123 21.18 MB/sec warmup 37 sec latency 63.016 ms 2020-11-20T11:31:50.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11339 20.77 MB/sec warmup 38 sec latency 63.966 ms 2020-11-20T11:31:51.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11419 20.27 MB/sec warmup 39 sec latency 789.960 ms 2020-11-20T11:31:52.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11473 19.77 MB/sec warmup 40 sec latency 1220.394 ms 2020-11-20T11:31:53.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11635 19.41 MB/sec warmup 41 sec latency 266.455 ms 2020-11-20T11:31:54.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 11851 19.20 MB/sec warmup 42 sec latency 162.240 ms 2020-11-20T11:31:55.195 INFO:tasks.workunit.client.0.smithi112.stdout: 10 12192 19.19 MB/sec warmup 43 sec latency 83.124 ms 2020-11-20T11:31:56.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 12696 19.26 MB/sec warmup 44 sec latency 107.969 ms 2020-11-20T11:31:57.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 13319 19.49 MB/sec warmup 45 sec latency 66.342 ms 2020-11-20T11:31:58.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 13770 19.90 MB/sec warmup 46 sec latency 63.282 ms 2020-11-20T11:31:59.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 14190 20.19 MB/sec warmup 47 sec latency 63.942 ms 2020-11-20T11:32:00.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 14455 20.16 MB/sec warmup 48 sec latency 54.221 ms 2020-11-20T11:32:01.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 14630 19.87 MB/sec warmup 49 sec latency 56.283 ms 2020-11-20T11:32:02.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 14812 19.54 MB/sec warmup 50 sec latency 149.009 ms 2020-11-20T11:32:03.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 15054 19.28 MB/sec warmup 51 sec latency 114.651 ms 2020-11-20T11:32:04.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 15249 19.03 MB/sec warmup 52 sec latency 224.786 ms 2020-11-20T11:32:05.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 15717 19.23 MB/sec warmup 53 sec latency 90.029 ms 2020-11-20T11:32:06.192 INFO:tasks.workunit.client.0.smithi112.stdout: 10 16075 19.16 MB/sec warmup 54 sec latency 442.337 ms 2020-11-20T11:32:07.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 16091 18.81 MB/sec warmup 55 sec latency 1441.540 ms 2020-11-20T11:32:08.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 16349 18.58 MB/sec warmup 56 sec latency 1531.236 ms 2020-11-20T11:32:09.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 16722 18.50 MB/sec warmup 57 sec latency 134.264 ms 2020-11-20T11:32:10.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 17040 18.73 MB/sec warmup 58 sec latency 89.626 ms 2020-11-20T11:32:11.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 17421 18.91 MB/sec warmup 59 sec latency 81.194 ms 2020-11-20T11:32:12.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 17722 18.97 MB/sec warmup 60 sec latency 236.472 ms 2020-11-20T11:32:13.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 18008 19.03 MB/sec warmup 61 sec latency 210.233 ms 2020-11-20T11:32:14.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 18158 18.79 MB/sec warmup 62 sec latency 109.313 ms 2020-11-20T11:32:15.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 18352 18.54 MB/sec warmup 63 sec latency 72.007 ms 2020-11-20T11:32:16.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 18583 18.34 MB/sec warmup 64 sec latency 121.871 ms 2020-11-20T11:32:17.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 18728 18.12 MB/sec warmup 65 sec latency 179.927 ms 2020-11-20T11:32:18.192 INFO:tasks.workunit.client.0.smithi112.stdout: 10 19119 18.11 MB/sec warmup 66 sec latency 108.841 ms 2020-11-20T11:32:19.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 19777 18.33 MB/sec warmup 67 sec latency 52.025 ms 2020-11-20T11:32:20.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 20308 18.35 MB/sec warmup 68 sec latency 268.324 ms 2020-11-20T11:32:21.191 INFO:tasks.workunit.client.0.smithi112.stdout: 10 20680 18.57 MB/sec warmup 69 sec latency 81.315 ms 2020-11-20T11:32:22.192 INFO:tasks.workunit.client.0.smithi112.stdout: 10 21116 18.75 MB/sec warmup 70 sec latency 136.713 ms 2020-11-20T11:32:23.192 INFO:tasks.workunit.client.0.smithi112.stdout: 10 21464 18.96 MB/sec warmup 71 sec latency 74.763 ms 2020-11-20T11:32:24.192 INFO:tasks.workunit.client.0.smithi112.stdout: 10 21657 18.82 MB/sec warmup 72 sec latency 70.708 ms 2020-11-20T11:32:25.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 21841 18.61 MB/sec warmup 73 sec latency 72.161 ms 2020-11-20T11:32:26.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22046 18.43 MB/sec warmup 74 sec latency 120.526 ms 2020-11-20T11:32:27.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22075 18.19 MB/sec warmup 75 sec latency 940.728 ms 2020-11-20T11:32:28.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22089 17.95 MB/sec warmup 76 sec latency 1299.390 ms 2020-11-20T11:32:29.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22259 17.78 MB/sec warmup 77 sec latency 1193.288 ms 2020-11-20T11:32:30.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22531 17.68 MB/sec warmup 78 sec latency 107.889 ms 2020-11-20T11:32:31.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 22866 17.69 MB/sec warmup 79 sec latency 96.601 ms 2020-11-20T11:32:32.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 23199 17.74 MB/sec warmup 80 sec latency 182.713 ms 2020-11-20T11:32:33.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 23724 17.71 MB/sec warmup 81 sec latency 98.883 ms 2020-11-20T11:32:34.193 INFO:tasks.workunit.client.0.smithi112.stdout: 10 24059 17.74 MB/sec warmup 82 sec latency 103.828 ms 2020-11-20T11:32:35.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 24478 18.00 MB/sec warmup 83 sec latency 89.334 ms 2020-11-20T11:32:36.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 24774 17.99 MB/sec warmup 84 sec latency 150.763 ms 2020-11-20T11:32:37.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25076 18.11 MB/sec warmup 85 sec latency 92.065 ms 2020-11-20T11:32:38.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25252 17.99 MB/sec warmup 86 sec latency 83.612 ms 2020-11-20T11:32:39.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25434 17.83 MB/sec warmup 87 sec latency 76.460 ms 2020-11-20T11:32:40.194 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25647 17.69 MB/sec warmup 88 sec latency 95.479 ms 2020-11-20T11:32:41.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25898 17.57 MB/sec warmup 89 sec latency 99.755 ms 2020-11-20T11:32:42.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 25989 17.41 MB/sec warmup 90 sec latency 696.000 ms 2020-11-20T11:32:43.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 26009 17.22 MB/sec warmup 91 sec latency 1279.325 ms 2020-11-20T11:32:44.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 26289 17.18 MB/sec warmup 92 sec latency 646.540 ms 2020-11-20T11:32:45.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 26692 17.29 MB/sec warmup 93 sec latency 113.436 ms 2020-11-20T11:32:46.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 27125 17.25 MB/sec warmup 94 sec latency 91.160 ms 2020-11-20T11:32:47.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 27644 17.38 MB/sec warmup 95 sec latency 78.406 ms 2020-11-20T11:32:48.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 28049 17.60 MB/sec warmup 96 sec latency 156.904 ms 2020-11-20T11:32:49.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 28446 17.66 MB/sec warmup 97 sec latency 69.364 ms 2020-11-20T11:32:50.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 28696 17.69 MB/sec warmup 98 sec latency 73.564 ms 2020-11-20T11:32:50.794 INFO:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:50.797 INFO:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:50.800 INFO:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:32:51.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 28893 17.59 MB/sec warmup 99 sec latency 80.633 ms 2020-11-20T11:32:51.872 INFO:tasks.ceph.mds.a.smithi112.stderr:2020-11-20T11:32:51.867+0000 7f23fcd7f700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 29447) UID: 0 2020-11-20T11:32:52.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 28999 17.42 MB/sec warmup 100 sec latency 368.028 ms 2020-11-20T11:32:53.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 29013 17.25 MB/sec warmup 101 sec latency 1000.952 ms 2020-11-20T11:32:53.886 INFO:tasks.ceph.osd.2.smithi204.stderr:2020-11-20T11:32:53.882+0000 7f650d71c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26208) UID: 0 2020-11-20T11:32:53.886 INFO:tasks.ceph.osd.5.smithi204.stderr:2020-11-20T11:32:53.882+0000 7f25cb75d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26208) UID: 0 2020-11-20T11:32:53.887 INFO:tasks.ceph.osd.8.smithi204.stderr:2020-11-20T11:32:53.882+0000 7fd192459700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26208) UID: 0 2020-11-20T11:32:53.887 INFO:tasks.ceph.osd.11.smithi204.stderr:2020-11-20T11:32:53.882+0000 7fadbabaf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26208) UID: 0 2020-11-20T11:32:54.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 29211 17.14 MB/sec warmup 102 sec latency 82.797 ms 2020-11-20T11:32:55.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 29444 17.05 MB/sec warmup 103 sec latency 150.670 ms 2020-11-20T11:32:56.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 29674 16.97 MB/sec warmup 104 sec latency 99.878 ms 2020-11-20T11:32:57.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 30125 17.01 MB/sec warmup 105 sec latency 101.238 ms 2020-11-20T11:32:58.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 30684 17.13 MB/sec warmup 106 sec latency 124.402 ms 2020-11-20T11:32:59.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 31171 17.19 MB/sec warmup 107 sec latency 81.992 ms 2020-11-20T11:33:00.197 INFO:tasks.workunit.client.0.smithi112.stdout: 10 31667 17.45 MB/sec warmup 108 sec latency 45.813 ms 2020-11-20T11:33:01.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 32010 17.47 MB/sec warmup 109 sec latency 77.066 ms 2020-11-20T11:33:02.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 32238 17.49 MB/sec warmup 110 sec latency 150.110 ms 2020-11-20T11:33:03.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 32439 17.40 MB/sec warmup 111 sec latency 82.237 ms 2020-11-20T11:33:04.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 32662 17.31 MB/sec warmup 112 sec latency 103.668 ms 2020-11-20T11:33:05.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 32931 17.21 MB/sec warmup 113 sec latency 58.115 ms 2020-11-20T11:33:06.198 INFO:tasks.workunit.client.0.smithi112.stdout: 10 33249 17.17 MB/sec warmup 114 sec latency 71.963 ms 2020-11-20T11:33:07.199 INFO:tasks.workunit.client.0.smithi112.stdout: 10 33641 17.20 MB/sec warmup 115 sec latency 68.670 ms 2020-11-20T11:33:08.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 33669 17.05 MB/sec warmup 116 sec latency 670.696 ms 2020-11-20T11:33:09.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 33760 16.96 MB/sec warmup 117 sec latency 1070.495 ms 2020-11-20T11:33:10.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 34113 17.00 MB/sec warmup 118 sec latency 153.624 ms 2020-11-20T11:33:11.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 34501 16.95 MB/sec warmup 119 sec latency 138.638 ms 2020-11-20T11:33:13.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 34892 11.69 MB/sec execute 1 sec latency 192.739 ms 2020-11-20T11:33:14.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 35188 19.60 MB/sec execute 2 sec latency 104.341 ms 2020-11-20T11:33:15.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 35491 19.24 MB/sec execute 3 sec latency 105.523 ms 2020-11-20T11:33:16.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 35712 20.07 MB/sec execute 4 sec latency 132.760 ms 2020-11-20T11:33:17.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 35887 17.27 MB/sec execute 5 sec latency 139.331 ms 2020-11-20T11:33:18.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 36053 15.60 MB/sec execute 6 sec latency 110.579 ms 2020-11-20T11:33:19.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 36239 13.90 MB/sec execute 7 sec latency 119.157 ms 2020-11-20T11:33:20.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 36461 12.94 MB/sec execute 8 sec latency 126.848 ms 2020-11-20T11:33:21.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 36651 12.09 MB/sec execute 9 sec latency 128.190 ms 2020-11-20T11:33:22.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 36873 12.24 MB/sec execute 10 sec latency 178.144 ms 2020-11-20T11:33:23.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 37226 12.44 MB/sec execute 11 sec latency 162.149 ms 2020-11-20T11:33:24.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 37634 13.73 MB/sec execute 12 sec latency 119.524 ms 2020-11-20T11:33:25.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 38105 14.13 MB/sec execute 13 sec latency 108.393 ms 2020-11-20T11:33:26.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 38362 13.98 MB/sec execute 14 sec latency 110.866 ms 2020-11-20T11:33:27.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 38655 14.99 MB/sec execute 15 sec latency 127.171 ms 2020-11-20T11:33:28.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 38992 15.36 MB/sec execute 16 sec latency 68.849 ms 2020-11-20T11:33:29.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 39248 15.58 MB/sec execute 17 sec latency 115.183 ms 2020-11-20T11:33:30.200 INFO:tasks.workunit.client.0.smithi112.stdout: 10 39454 15.48 MB/sec execute 18 sec latency 125.271 ms 2020-11-20T11:33:31.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 39640 15.06 MB/sec execute 19 sec latency 90.501 ms 2020-11-20T11:33:32.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 39821 14.49 MB/sec execute 20 sec latency 229.761 ms 2020-11-20T11:33:33.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 40029 14.12 MB/sec execute 21 sec latency 250.866 ms 2020-11-20T11:33:34.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 40297 13.87 MB/sec execute 22 sec latency 108.965 ms 2020-11-20T11:33:35.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 40477 13.77 MB/sec execute 23 sec latency 188.333 ms 2020-11-20T11:33:36.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 40772 13.79 MB/sec execute 24 sec latency 104.237 ms 2020-11-20T11:33:37.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 41118 14.11 MB/sec execute 25 sec latency 113.603 ms 2020-11-20T11:33:38.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 41515 14.15 MB/sec execute 26 sec latency 244.588 ms 2020-11-20T11:33:39.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 41870 14.29 MB/sec execute 27 sec latency 117.320 ms 2020-11-20T11:33:40.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 42208 14.78 MB/sec execute 28 sec latency 82.337 ms 2020-11-20T11:33:41.201 INFO:tasks.workunit.client.0.smithi112.stdout: 10 42523 15.04 MB/sec execute 29 sec latency 96.120 ms 2020-11-20T11:33:42.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 42767 15.10 MB/sec execute 30 sec latency 192.066 ms 2020-11-20T11:33:43.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 42976 15.12 MB/sec execute 31 sec latency 150.037 ms 2020-11-20T11:33:44.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 43184 14.92 MB/sec execute 32 sec latency 100.591 ms 2020-11-20T11:33:45.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 43400 14.64 MB/sec execute 33 sec latency 112.215 ms 2020-11-20T11:33:46.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 43646 14.38 MB/sec execute 34 sec latency 115.830 ms 2020-11-20T11:33:47.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 43863 14.20 MB/sec execute 35 sec latency 145.180 ms 2020-11-20T11:33:48.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 44065 14.17 MB/sec execute 36 sec latency 189.190 ms 2020-11-20T11:33:49.204 INFO:tasks.workunit.client.0.smithi112.stdout: 10 44467 14.36 MB/sec execute 37 sec latency 105.710 ms 2020-11-20T11:33:50.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 44845 14.57 MB/sec execute 38 sec latency 151.032 ms 2020-11-20T11:33:51.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 45219 14.56 MB/sec execute 39 sec latency 185.591 ms 2020-11-20T11:33:52.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 45490 14.51 MB/sec execute 40 sec latency 137.925 ms 2020-11-20T11:33:53.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 45742 14.70 MB/sec execute 41 sec latency 136.351 ms 2020-11-20T11:33:54.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 46060 14.90 MB/sec execute 42 sec latency 157.889 ms 2020-11-20T11:33:55.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 46352 15.04 MB/sec execute 43 sec latency 83.875 ms 2020-11-20T11:33:56.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 46573 15.01 MB/sec execute 44 sec latency 74.408 ms 2020-11-20T11:33:57.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 46787 14.93 MB/sec execute 45 sec latency 85.472 ms 2020-11-20T11:33:58.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 47036 14.70 MB/sec execute 46 sec latency 83.000 ms 2020-11-20T11:33:59.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 47270 14.53 MB/sec execute 47 sec latency 167.133 ms 2020-11-20T11:34:00.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 47471 14.40 MB/sec execute 48 sec latency 136.243 ms 2020-11-20T11:34:01.207 INFO:tasks.workunit.client.0.smithi112.stdout: 10 47792 14.54 MB/sec execute 49 sec latency 97.472 ms 2020-11-20T11:34:02.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 48134 14.60 MB/sec execute 50 sec latency 199.290 ms 2020-11-20T11:34:03.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 48555 14.68 MB/sec execute 51 sec latency 139.404 ms 2020-11-20T11:34:04.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 48884 14.72 MB/sec execute 52 sec latency 104.006 ms 2020-11-20T11:34:05.208 INFO:tasks.workunit.client.0.smithi112.stdout: 10 49234 14.91 MB/sec execute 53 sec latency 98.398 ms 2020-11-20T11:34:06.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 49569 15.11 MB/sec execute 54 sec latency 75.344 ms 2020-11-20T11:34:07.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 49810 15.15 MB/sec execute 55 sec latency 85.587 ms 2020-11-20T11:34:08.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 50026 15.18 MB/sec execute 56 sec latency 77.662 ms 2020-11-20T11:34:09.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 50208 15.06 MB/sec execute 57 sec latency 79.762 ms 2020-11-20T11:34:10.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 50429 14.90 MB/sec execute 58 sec latency 84.666 ms 2020-11-20T11:34:11.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 50676 14.72 MB/sec execute 59 sec latency 133.161 ms 2020-11-20T11:34:12.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 50875 14.59 MB/sec execute 60 sec latency 203.150 ms 2020-11-20T11:34:13.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 51095 14.59 MB/sec execute 61 sec latency 210.024 ms 2020-11-20T11:34:14.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 51475 14.71 MB/sec execute 62 sec latency 92.315 ms 2020-11-20T11:34:15.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 51862 14.77 MB/sec execute 63 sec latency 125.290 ms 2020-11-20T11:34:16.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 52196 14.73 MB/sec execute 64 sec latency 172.595 ms 2020-11-20T11:34:17.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 52507 14.77 MB/sec execute 65 sec latency 154.882 ms 2020-11-20T11:34:18.327 INFO:tasks.workunit.client.0.smithi112.stdout: 10 52847 14.97 MB/sec execute 66 sec latency 81.262 ms 2020-11-20T11:34:19.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 53149 15.05 MB/sec execute 67 sec latency 98.169 ms 2020-11-20T11:34:20.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 53395 15.08 MB/sec execute 68 sec latency 147.967 ms 2020-11-20T11:34:21.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 53595 15.10 MB/sec execute 69 sec latency 118.972 ms 2020-11-20T11:34:22.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 53749 15.00 MB/sec execute 70 sec latency 168.609 ms 2020-11-20T11:34:23.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 53983 14.87 MB/sec execute 71 sec latency 86.360 ms 2020-11-20T11:34:24.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 54200 14.71 MB/sec execute 72 sec latency 78.362 ms 2020-11-20T11:34:25.209 INFO:tasks.workunit.client.0.smithi112.stdout: 10 54419 14.60 MB/sec execute 73 sec latency 115.104 ms 2020-11-20T11:34:26.212 INFO:tasks.workunit.client.0.smithi112.stdout: 10 54657 14.62 MB/sec execute 74 sec latency 116.853 ms 2020-11-20T11:34:27.212 INFO:tasks.workunit.client.0.smithi112.stdout: 10 54952 14.60 MB/sec execute 75 sec latency 110.497 ms 2020-11-20T11:34:28.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 55359 14.76 MB/sec execute 76 sec latency 154.991 ms 2020-11-20T11:34:29.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 55798 14.77 MB/sec execute 77 sec latency 180.159 ms 2020-11-20T11:34:30.212 INFO:tasks.workunit.client.0.smithi112.stdout: 10 56067 14.76 MB/sec execute 78 sec latency 163.034 ms 2020-11-20T11:34:31.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 56365 14.85 MB/sec execute 79 sec latency 96.277 ms 2020-11-20T11:34:32.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 56666 14.96 MB/sec execute 80 sec latency 126.531 ms 2020-11-20T11:34:33.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 56956 15.05 MB/sec execute 81 sec latency 152.299 ms 2020-11-20T11:34:34.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 57172 15.05 MB/sec execute 82 sec latency 98.042 ms 2020-11-20T11:34:35.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 57378 14.97 MB/sec execute 83 sec latency 77.592 ms 2020-11-20T11:34:36.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 57608 14.87 MB/sec execute 84 sec latency 96.364 ms 2020-11-20T11:34:37.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 57861 14.79 MB/sec execute 85 sec latency 101.333 ms 2020-11-20T11:34:38.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 58030 14.68 MB/sec execute 86 sec latency 192.135 ms 2020-11-20T11:34:39.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 58267 14.69 MB/sec execute 87 sec latency 115.675 ms 2020-11-20T11:34:40.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 58628 14.73 MB/sec execute 88 sec latency 88.813 ms 2020-11-20T11:34:41.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 58935 14.77 MB/sec execute 89 sec latency 152.055 ms 2020-11-20T11:34:42.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 59332 14.75 MB/sec execute 90 sec latency 161.872 ms 2020-11-20T11:34:43.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 59592 14.74 MB/sec execute 91 sec latency 182.001 ms 2020-11-20T11:34:44.217 INFO:tasks.workunit.client.0.smithi112.stdout: 10 59897 14.81 MB/sec execute 92 sec latency 85.235 ms 2020-11-20T11:34:45.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 60193 14.92 MB/sec execute 93 sec latency 97.497 ms 2020-11-20T11:34:46.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 60499 15.00 MB/sec execute 94 sec latency 105.271 ms 2020-11-20T11:34:47.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 60731 15.03 MB/sec execute 95 sec latency 115.779 ms 2020-11-20T11:34:48.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 60926 14.93 MB/sec execute 96 sec latency 89.368 ms 2020-11-20T11:34:49.213 INFO:tasks.workunit.client.0.smithi112.stdout: 10 61135 14.85 MB/sec execute 97 sec latency 81.069 ms 2020-11-20T11:34:50.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 61342 14.75 MB/sec execute 98 sec latency 99.722 ms 2020-11-20T11:34:51.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 61540 14.67 MB/sec execute 99 sec latency 117.879 ms 2020-11-20T11:34:52.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 61744 14.64 MB/sec execute 100 sec latency 161.602 ms 2020-11-20T11:34:53.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 62041 14.66 MB/sec execute 101 sec latency 137.958 ms 2020-11-20T11:34:54.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 62424 14.70 MB/sec execute 102 sec latency 199.919 ms 2020-11-20T11:34:55.217 INFO:tasks.workunit.client.0.smithi112.stdout: 10 62806 14.74 MB/sec execute 103 sec latency 156.803 ms 2020-11-20T11:34:56.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 63154 14.75 MB/sec execute 104 sec latency 102.305 ms 2020-11-20T11:34:57.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 63469 14.84 MB/sec execute 105 sec latency 85.115 ms 2020-11-20T11:34:58.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 63778 14.92 MB/sec execute 106 sec latency 108.171 ms 2020-11-20T11:34:59.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 64021 14.94 MB/sec execute 107 sec latency 127.663 ms 2020-11-20T11:35:00.216 INFO:tasks.workunit.client.0.smithi112.stdout: 10 64269 14.99 MB/sec execute 108 sec latency 99.917 ms 2020-11-20T11:35:01.219 INFO:tasks.workunit.client.0.smithi112.stdout: 10 64478 14.93 MB/sec execute 109 sec latency 102.790 ms 2020-11-20T11:35:02.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 64677 14.83 MB/sec execute 110 sec latency 111.367 ms 2020-11-20T11:35:03.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 64899 14.76 MB/sec execute 111 sec latency 104.274 ms 2020-11-20T11:35:04.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 65087 14.70 MB/sec execute 112 sec latency 119.094 ms 2020-11-20T11:35:05.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 65290 14.66 MB/sec execute 113 sec latency 145.315 ms 2020-11-20T11:35:06.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 65611 14.68 MB/sec execute 114 sec latency 121.433 ms 2020-11-20T11:35:07.223 INFO:tasks.workunit.client.0.smithi112.stdout: 10 65936 14.70 MB/sec execute 115 sec latency 161.653 ms 2020-11-20T11:35:08.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 66337 14.74 MB/sec execute 116 sec latency 107.140 ms 2020-11-20T11:35:09.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 66652 14.73 MB/sec execute 117 sec latency 169.883 ms 2020-11-20T11:35:10.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 66950 14.78 MB/sec execute 118 sec latency 86.470 ms 2020-11-20T11:35:11.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 67248 14.86 MB/sec execute 119 sec latency 168.478 ms 2020-11-20T11:35:12.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 67483 14.85 MB/sec execute 120 sec latency 142.798 ms 2020-11-20T11:35:13.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 67725 14.86 MB/sec execute 121 sec latency 126.037 ms 2020-11-20T11:35:14.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 67935 14.86 MB/sec execute 122 sec latency 148.327 ms 2020-11-20T11:35:15.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 68157 14.81 MB/sec execute 123 sec latency 105.279 ms 2020-11-20T11:35:16.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 68403 14.73 MB/sec execute 124 sec latency 83.374 ms 2020-11-20T11:35:17.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 68623 14.70 MB/sec execute 125 sec latency 127.984 ms 2020-11-20T11:35:18.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 68830 14.65 MB/sec execute 126 sec latency 117.276 ms 2020-11-20T11:35:19.225 INFO:tasks.workunit.client.0.smithi112.stdout: 10 69070 14.62 MB/sec execute 127 sec latency 162.942 ms 2020-11-20T11:35:20.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 69346 14.65 MB/sec execute 128 sec latency 125.192 ms 2020-11-20T11:35:21.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 69788 14.72 MB/sec execute 129 sec latency 128.281 ms 2020-11-20T11:35:22.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 70049 14.66 MB/sec execute 130 sec latency 194.944 ms 2020-11-20T11:35:23.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 70383 14.71 MB/sec execute 131 sec latency 170.794 ms 2020-11-20T11:35:24.223 INFO:tasks.workunit.client.0.smithi112.stdout: 10 70652 14.76 MB/sec execute 132 sec latency 97.694 ms 2020-11-20T11:35:25.222 INFO:tasks.workunit.client.0.smithi112.stdout: 10 70966 14.81 MB/sec execute 133 sec latency 88.258 ms 2020-11-20T11:35:26.226 INFO:tasks.workunit.client.0.smithi112.stdout: 10 71208 14.83 MB/sec execute 134 sec latency 156.179 ms 2020-11-20T11:35:27.226 INFO:tasks.workunit.client.0.smithi112.stdout: 10 71401 14.83 MB/sec execute 135 sec latency 100.107 ms 2020-11-20T11:35:28.226 INFO:tasks.workunit.client.0.smithi112.stdout: 10 71596 14.78 MB/sec execute 136 sec latency 103.522 ms 2020-11-20T11:35:29.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 71859 14.71 MB/sec execute 137 sec latency 114.263 ms 2020-11-20T11:35:30.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72038 14.63 MB/sec execute 138 sec latency 98.987 ms 2020-11-20T11:35:31.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72214 14.59 MB/sec execute 139 sec latency 145.256 ms 2020-11-20T11:35:32.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72317 14.52 MB/sec execute 140 sec latency 395.384 ms 2020-11-20T11:35:33.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72372 14.44 MB/sec execute 141 sec latency 673.193 ms 2020-11-20T11:35:34.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72640 14.43 MB/sec execute 142 sec latency 345.941 ms 2020-11-20T11:35:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: 10 72917 14.48 MB/sec execute 143 sec latency 166.713 ms 2020-11-20T11:35:36.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 73276 14.50 MB/sec execute 144 sec latency 172.557 ms 2020-11-20T11:35:37.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 73553 14.45 MB/sec execute 145 sec latency 287.076 ms 2020-11-20T11:35:38.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 73875 14.48 MB/sec execute 146 sec latency 154.705 ms 2020-11-20T11:35:39.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 74085 14.48 MB/sec execute 147 sec latency 95.726 ms 2020-11-20T11:35:40.227 INFO:tasks.workunit.client.0.smithi112.stdout: 10 74381 14.54 MB/sec execute 148 sec latency 93.443 ms 2020-11-20T11:35:41.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 74667 14.55 MB/sec execute 149 sec latency 109.319 ms 2020-11-20T11:35:42.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 74860 14.58 MB/sec execute 150 sec latency 166.221 ms 2020-11-20T11:35:43.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 75078 14.56 MB/sec execute 151 sec latency 169.390 ms 2020-11-20T11:35:44.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 75293 14.50 MB/sec execute 152 sec latency 93.654 ms 2020-11-20T11:35:45.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 75517 14.44 MB/sec execute 153 sec latency 114.642 ms 2020-11-20T11:35:46.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 75741 14.40 MB/sec execute 154 sec latency 139.283 ms 2020-11-20T11:35:47.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 75925 14.36 MB/sec execute 155 sec latency 161.679 ms 2020-11-20T11:35:48.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 76218 14.38 MB/sec execute 156 sec latency 107.688 ms 2020-11-20T11:35:49.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 76552 14.41 MB/sec execute 157 sec latency 89.877 ms 2020-11-20T11:35:50.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 76948 14.44 MB/sec execute 158 sec latency 152.531 ms 2020-11-20T11:35:51.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 77290 14.42 MB/sec execute 159 sec latency 159.685 ms 2020-11-20T11:35:52.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 77511 14.44 MB/sec execute 160 sec latency 199.164 ms 2020-11-20T11:35:53.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 77812 14.49 MB/sec execute 161 sec latency 140.838 ms 2020-11-20T11:35:54.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 78102 14.52 MB/sec execute 162 sec latency 99.094 ms 2020-11-20T11:35:55.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 78366 14.55 MB/sec execute 163 sec latency 95.219 ms 2020-11-20T11:35:56.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 78577 14.55 MB/sec execute 164 sec latency 110.569 ms 2020-11-20T11:35:57.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 78783 14.51 MB/sec execute 165 sec latency 89.293 ms 2020-11-20T11:35:58.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 79001 14.45 MB/sec execute 166 sec latency 105.156 ms 2020-11-20T11:35:59.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 79249 14.43 MB/sec execute 167 sec latency 91.108 ms 2020-11-20T11:36:00.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 79432 14.38 MB/sec execute 168 sec latency 128.678 ms 2020-11-20T11:36:01.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 79719 14.39 MB/sec execute 169 sec latency 125.688 ms 2020-11-20T11:36:02.230 INFO:tasks.workunit.client.0.smithi112.stdout: 10 79962 14.39 MB/sec execute 170 sec latency 142.391 ms 2020-11-20T11:36:03.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 80341 14.45 MB/sec execute 171 sec latency 164.840 ms 2020-11-20T11:36:04.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 80737 14.42 MB/sec execute 172 sec latency 141.488 ms 2020-11-20T11:36:05.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 81036 14.45 MB/sec execute 173 sec latency 153.618 ms 2020-11-20T11:36:06.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 81324 14.49 MB/sec execute 174 sec latency 111.452 ms 2020-11-20T11:36:07.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 81660 14.54 MB/sec execute 175 sec latency 64.707 ms 2020-11-20T11:36:08.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 81911 14.56 MB/sec execute 176 sec latency 111.645 ms 2020-11-20T11:36:09.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 82131 14.57 MB/sec execute 177 sec latency 125.697 ms 2020-11-20T11:36:10.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 82336 14.52 MB/sec execute 178 sec latency 119.224 ms 2020-11-20T11:36:11.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 82573 14.47 MB/sec execute 179 sec latency 81.671 ms 2020-11-20T11:36:12.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 82755 14.43 MB/sec execute 180 sec latency 174.178 ms 2020-11-20T11:36:13.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 82992 14.40 MB/sec execute 181 sec latency 209.030 ms 2020-11-20T11:36:14.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 83259 14.42 MB/sec execute 182 sec latency 111.634 ms 2020-11-20T11:36:15.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 83508 14.40 MB/sec execute 183 sec latency 133.913 ms 2020-11-20T11:36:16.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 83889 14.47 MB/sec execute 184 sec latency 101.660 ms 2020-11-20T11:36:17.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 84243 14.44 MB/sec execute 185 sec latency 117.357 ms 2020-11-20T11:36:18.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 84570 14.46 MB/sec execute 186 sec latency 117.838 ms 2020-11-20T11:36:19.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 84822 14.48 MB/sec execute 187 sec latency 94.154 ms 2020-11-20T11:36:20.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 85088 14.52 MB/sec execute 188 sec latency 93.581 ms 2020-11-20T11:36:21.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 85340 14.51 MB/sec execute 189 sec latency 100.968 ms 2020-11-20T11:36:22.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 85585 14.54 MB/sec execute 190 sec latency 147.698 ms 2020-11-20T11:36:23.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 85779 14.53 MB/sec execute 191 sec latency 156.894 ms 2020-11-20T11:36:24.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 85988 14.47 MB/sec execute 192 sec latency 343.273 ms 2020-11-20T11:36:25.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 86239 14.44 MB/sec execute 193 sec latency 506.423 ms 2020-11-20T11:36:26.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 86401 14.39 MB/sec execute 194 sec latency 145.313 ms 2020-11-20T11:36:27.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 86673 14.38 MB/sec execute 195 sec latency 95.246 ms 2020-11-20T11:36:28.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 86946 14.38 MB/sec execute 196 sec latency 147.154 ms 2020-11-20T11:36:29.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 87393 14.45 MB/sec execute 197 sec latency 150.691 ms 2020-11-20T11:36:30.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 87715 14.45 MB/sec execute 198 sec latency 148.557 ms 2020-11-20T11:36:31.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 88073 14.47 MB/sec execute 199 sec latency 104.754 ms 2020-11-20T11:36:32.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 88322 14.49 MB/sec execute 200 sec latency 199.582 ms 2020-11-20T11:36:33.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 88624 14.53 MB/sec execute 201 sec latency 220.175 ms 2020-11-20T11:36:34.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 88877 14.54 MB/sec execute 202 sec latency 238.037 ms 2020-11-20T11:36:35.231 INFO:tasks.workunit.client.0.smithi112.stdout: 10 89108 14.55 MB/sec execute 203 sec latency 133.877 ms 2020-11-20T11:36:36.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 89326 14.54 MB/sec execute 204 sec latency 96.187 ms 2020-11-20T11:36:37.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 89553 14.49 MB/sec execute 205 sec latency 125.055 ms 2020-11-20T11:36:38.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 89790 14.45 MB/sec execute 206 sec latency 87.931 ms 2020-11-20T11:36:39.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 89963 14.41 MB/sec execute 207 sec latency 127.374 ms 2020-11-20T11:36:40.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 90251 14.41 MB/sec execute 208 sec latency 131.123 ms 2020-11-20T11:36:41.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 90461 14.40 MB/sec execute 209 sec latency 142.981 ms 2020-11-20T11:36:42.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 90689 14.40 MB/sec execute 210 sec latency 240.237 ms 2020-11-20T11:36:43.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 91005 14.42 MB/sec execute 211 sec latency 221.332 ms 2020-11-20T11:36:44.232 INFO:tasks.workunit.client.0.smithi112.stdout: 10 91324 14.41 MB/sec execute 212 sec latency 166.083 ms 2020-11-20T11:36:45.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 91622 14.43 MB/sec execute 213 sec latency 131.377 ms 2020-11-20T11:36:46.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 91927 14.46 MB/sec execute 214 sec latency 96.079 ms 2020-11-20T11:36:47.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 92292 14.52 MB/sec execute 215 sec latency 73.997 ms 2020-11-20T11:36:48.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 92514 14.51 MB/sec execute 216 sec latency 100.089 ms 2020-11-20T11:36:49.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 92714 14.51 MB/sec execute 217 sec latency 105.137 ms 2020-11-20T11:36:50.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 92928 14.49 MB/sec execute 218 sec latency 74.779 ms 2020-11-20T11:36:51.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 93124 14.44 MB/sec execute 219 sec latency 117.184 ms 2020-11-20T11:36:52.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 93355 14.41 MB/sec execute 220 sec latency 192.853 ms 2020-11-20T11:36:53.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 93549 14.36 MB/sec execute 221 sec latency 227.507 ms 2020-11-20T11:36:54.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 93820 14.36 MB/sec execute 222 sec latency 124.597 ms 2020-11-20T11:36:55.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 94057 14.37 MB/sec execute 223 sec latency 153.606 ms 2020-11-20T11:36:56.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 94534 14.42 MB/sec execute 224 sec latency 105.514 ms 2020-11-20T11:36:57.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 94846 14.42 MB/sec execute 225 sec latency 134.516 ms 2020-11-20T11:36:58.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 95193 14.45 MB/sec execute 226 sec latency 108.506 ms 2020-11-20T11:36:59.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 95468 14.46 MB/sec execute 227 sec latency 77.103 ms 2020-11-20T11:37:00.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 95792 14.52 MB/sec execute 228 sec latency 96.251 ms 2020-11-20T11:37:01.237 INFO:tasks.workunit.client.0.smithi112.stdout: 10 96017 14.52 MB/sec execute 229 sec latency 125.386 ms 2020-11-20T11:37:02.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 96162 14.48 MB/sec execute 230 sec latency 244.375 ms 2020-11-20T11:37:03.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 96336 14.47 MB/sec execute 231 sec latency 290.541 ms 2020-11-20T11:37:04.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 96557 14.45 MB/sec execute 232 sec latency 90.106 ms 2020-11-20T11:37:05.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 96809 14.41 MB/sec execute 233 sec latency 113.995 ms 2020-11-20T11:37:06.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 97005 14.37 MB/sec execute 234 sec latency 124.578 ms 2020-11-20T11:37:07.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 97249 14.34 MB/sec execute 235 sec latency 120.031 ms 2020-11-20T11:37:08.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 97528 14.38 MB/sec execute 236 sec latency 123.007 ms 2020-11-20T11:37:09.233 INFO:tasks.workunit.client.0.smithi112.stdout: 10 97879 14.40 MB/sec execute 237 sec latency 144.537 ms 2020-11-20T11:37:10.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 98337 14.42 MB/sec execute 238 sec latency 148.798 ms 2020-11-20T11:37:11.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 98632 14.42 MB/sec execute 239 sec latency 112.817 ms 2020-11-20T11:37:12.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 98862 14.44 MB/sec execute 240 sec latency 212.556 ms 2020-11-20T11:37:13.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 99171 14.47 MB/sec execute 241 sec latency 210.406 ms 2020-11-20T11:37:14.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 99463 14.50 MB/sec execute 242 sec latency 78.160 ms 2020-11-20T11:37:15.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 99678 14.50 MB/sec execute 243 sec latency 97.260 ms 2020-11-20T11:37:16.234 INFO:tasks.workunit.client.0.smithi112.stdout: 10 99856 14.48 MB/sec execute 244 sec latency 88.305 ms 2020-11-20T11:37:17.235 INFO:tasks.workunit.client.0.smithi112.stdout: 10 100084 14.46 MB/sec execute 245 sec latency 58.631 ms 2020-11-20T11:37:18.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 100338 14.42 MB/sec execute 246 sec latency 88.398 ms 2020-11-20T11:37:19.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 100536 14.38 MB/sec execute 247 sec latency 106.896 ms 2020-11-20T11:37:20.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 100741 14.35 MB/sec execute 248 sec latency 162.988 ms 2020-11-20T11:37:21.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 101060 14.39 MB/sec execute 249 sec latency 96.807 ms 2020-11-20T11:37:22.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 101414 14.42 MB/sec execute 250 sec latency 210.080 ms 2020-11-20T11:37:23.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 101848 14.43 MB/sec execute 251 sec latency 202.161 ms 2020-11-20T11:37:24.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 102148 14.43 MB/sec execute 252 sec latency 139.340 ms 2020-11-20T11:37:25.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 102438 14.46 MB/sec execute 253 sec latency 77.461 ms 2020-11-20T11:37:26.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 102740 14.49 MB/sec execute 254 sec latency 79.549 ms 2020-11-20T11:37:27.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 103008 14.51 MB/sec execute 255 sec latency 101.266 ms 2020-11-20T11:37:28.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 103229 14.52 MB/sec execute 256 sec latency 111.463 ms 2020-11-20T11:37:29.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 103413 14.49 MB/sec execute 257 sec latency 98.019 ms 2020-11-20T11:37:30.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 103664 14.48 MB/sec execute 258 sec latency 99.763 ms 2020-11-20T11:37:31.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 103943 14.44 MB/sec execute 259 sec latency 98.851 ms 2020-11-20T11:37:32.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 104126 14.40 MB/sec execute 260 sec latency 243.860 ms 2020-11-20T11:37:33.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 104275 14.37 MB/sec execute 261 sec latency 307.400 ms 2020-11-20T11:37:34.236 INFO:tasks.workunit.client.0.smithi112.stdout: 10 104503 14.38 MB/sec execute 262 sec latency 111.507 ms 2020-11-20T11:37:35.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 104890 14.42 MB/sec execute 263 sec latency 112.977 ms 2020-11-20T11:37:36.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 105327 14.44 MB/sec execute 264 sec latency 131.302 ms 2020-11-20T11:37:37.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 105698 14.44 MB/sec execute 265 sec latency 128.524 ms 2020-11-20T11:37:38.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 105898 14.44 MB/sec execute 266 sec latency 101.682 ms 2020-11-20T11:37:39.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 106247 14.50 MB/sec execute 267 sec latency 71.962 ms 2020-11-20T11:37:40.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 106546 14.51 MB/sec execute 268 sec latency 109.353 ms 2020-11-20T11:37:41.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 106767 14.52 MB/sec execute 269 sec latency 108.112 ms 2020-11-20T11:37:42.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 106915 14.50 MB/sec execute 270 sec latency 215.086 ms 2020-11-20T11:37:43.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 107124 14.48 MB/sec execute 271 sec latency 224.117 ms 2020-11-20T11:37:44.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 107404 14.45 MB/sec execute 272 sec latency 74.785 ms 2020-11-20T11:37:45.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 107616 14.41 MB/sec execute 273 sec latency 166.097 ms 2020-11-20T11:37:46.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 107793 14.39 MB/sec execute 274 sec latency 206.689 ms 2020-11-20T11:37:47.239 INFO:tasks.workunit.client.0.smithi112.stdout: 10 108028 14.39 MB/sec execute 275 sec latency 112.530 ms 2020-11-20T11:37:48.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 108414 14.42 MB/sec execute 276 sec latency 115.159 ms 2020-11-20T11:37:49.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 108775 14.45 MB/sec execute 277 sec latency 168.546 ms 2020-11-20T11:37:50.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 109101 14.43 MB/sec execute 278 sec latency 128.365 ms 2020-11-20T11:37:51.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 109425 14.45 MB/sec execute 279 sec latency 117.114 ms 2020-11-20T11:37:52.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 109691 14.47 MB/sec execute 280 sec latency 197.635 ms 2020-11-20T11:37:53.239 INFO:tasks.workunit.client.0.smithi112.stdout: 10 109977 14.49 MB/sec execute 281 sec latency 184.780 ms 2020-11-20T11:37:54.238 INFO:tasks.workunit.client.0.smithi112.stdout: 10 110244 14.51 MB/sec execute 282 sec latency 134.704 ms 2020-11-20T11:37:55.239 INFO:tasks.workunit.client.0.smithi112.stdout: 10 110463 14.50 MB/sec execute 283 sec latency 91.710 ms 2020-11-20T11:37:56.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 110686 14.49 MB/sec execute 284 sec latency 71.983 ms 2020-11-20T11:37:57.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 110951 14.46 MB/sec execute 285 sec latency 95.508 ms 2020-11-20T11:37:58.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 111151 14.43 MB/sec execute 286 sec latency 137.849 ms 2020-11-20T11:37:59.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 111361 14.41 MB/sec execute 287 sec latency 119.679 ms 2020-11-20T11:38:00.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 111558 14.40 MB/sec execute 288 sec latency 119.205 ms 2020-11-20T11:38:01.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 111914 14.43 MB/sec execute 289 sec latency 114.824 ms 2020-11-20T11:38:02.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 112276 14.45 MB/sec execute 290 sec latency 271.409 ms 2020-11-20T11:38:03.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 112509 14.44 MB/sec execute 291 sec latency 285.349 ms 2020-11-20T11:38:04.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 112928 14.45 MB/sec execute 292 sec latency 125.108 ms 2020-11-20T11:38:05.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 113180 14.46 MB/sec execute 293 sec latency 82.986 ms 2020-11-20T11:38:06.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 113455 14.49 MB/sec execute 294 sec latency 120.241 ms 2020-11-20T11:38:07.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 113702 14.48 MB/sec execute 295 sec latency 102.420 ms 2020-11-20T11:38:08.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 113925 14.50 MB/sec execute 296 sec latency 119.889 ms 2020-11-20T11:38:09.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 114109 14.49 MB/sec execute 297 sec latency 229.177 ms 2020-11-20T11:38:10.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 114373 14.47 MB/sec execute 298 sec latency 87.702 ms 2020-11-20T11:38:11.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 114611 14.44 MB/sec execute 299 sec latency 104.558 ms 2020-11-20T11:38:12.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 114773 14.40 MB/sec execute 300 sec latency 224.388 ms 2020-11-20T11:38:13.241 INFO:tasks.workunit.client.0.smithi112.stdout: 10 114901 14.37 MB/sec execute 301 sec latency 274.922 ms 2020-11-20T11:38:14.242 INFO:tasks.workunit.client.0.smithi112.stdout: 10 115148 14.38 MB/sec execute 302 sec latency 207.763 ms 2020-11-20T11:38:15.242 INFO:tasks.workunit.client.0.smithi112.stdout: 10 115539 14.41 MB/sec execute 303 sec latency 111.610 ms 2020-11-20T11:38:16.243 INFO:tasks.workunit.client.0.smithi112.stdout: 10 115960 14.44 MB/sec execute 304 sec latency 148.788 ms 2020-11-20T11:38:17.243 INFO:tasks.workunit.client.0.smithi112.stdout: 10 116255 14.42 MB/sec execute 305 sec latency 109.451 ms 2020-11-20T11:38:18.243 INFO:tasks.workunit.client.0.smithi112.stdout: 10 116551 14.43 MB/sec execute 306 sec latency 84.987 ms 2020-11-20T11:38:19.244 INFO:tasks.workunit.client.0.smithi112.stdout: 10 116924 14.48 MB/sec execute 307 sec latency 84.187 ms 2020-11-20T11:38:20.244 INFO:tasks.workunit.client.0.smithi112.stdout: 10 117202 14.49 MB/sec execute 308 sec latency 124.935 ms 2020-11-20T11:38:21.244 INFO:tasks.workunit.client.0.smithi112.stdout: 10 117431 14.51 MB/sec execute 309 sec latency 134.174 ms 2020-11-20T11:38:22.244 INFO:tasks.workunit.client.0.smithi112.stdout: 10 117596 14.48 MB/sec execute 310 sec latency 215.101 ms 2020-11-20T11:38:23.244 INFO:tasks.workunit.client.0.smithi112.stdout: 10 117850 14.48 MB/sec execute 311 sec latency 208.378 ms 2020-11-20T11:38:24.246 INFO:tasks.workunit.client.0.smithi112.stdout: 10 118118 14.44 MB/sec execute 312 sec latency 118.752 ms 2020-11-20T11:38:25.247 INFO:tasks.workunit.client.0.smithi112.stdout: 10 118316 14.41 MB/sec execute 313 sec latency 156.334 ms 2020-11-20T11:38:26.247 INFO:tasks.workunit.client.0.smithi112.stdout: 10 118541 14.41 MB/sec execute 314 sec latency 121.531 ms 2020-11-20T11:38:27.247 INFO:tasks.workunit.client.0.smithi112.stdout: 10 118848 14.43 MB/sec execute 315 sec latency 132.109 ms 2020-11-20T11:38:28.251 INFO:tasks.workunit.client.0.smithi112.stdout: 10 119144 14.43 MB/sec execute 316 sec latency 96.324 ms 2020-11-20T11:38:29.251 INFO:tasks.workunit.client.0.smithi112.stdout: 10 119580 14.46 MB/sec execute 317 sec latency 124.044 ms 2020-11-20T11:38:30.251 INFO:tasks.workunit.client.0.smithi112.stdout: 10 119949 14.46 MB/sec execute 318 sec latency 150.910 ms 2020-11-20T11:38:31.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 120154 14.46 MB/sec execute 319 sec latency 79.841 ms 2020-11-20T11:38:32.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 120501 14.50 MB/sec execute 320 sec latency 175.235 ms 2020-11-20T11:38:33.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 120756 14.50 MB/sec execute 321 sec latency 205.516 ms 2020-11-20T11:38:34.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 120985 14.52 MB/sec execute 322 sec latency 100.259 ms 2020-11-20T11:38:35.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 121174 14.50 MB/sec execute 323 sec latency 109.358 ms 2020-11-20T11:38:36.253 INFO:tasks.workunit.client.0.smithi112.stdout: 10 121437 14.49 MB/sec execute 324 sec latency 70.360 ms 2020-11-20T11:38:37.252 INFO:tasks.workunit.client.0.smithi112.stdout: 10 121668 14.46 MB/sec execute 325 sec latency 125.289 ms 2020-11-20T11:38:38.253 INFO:tasks.workunit.client.0.smithi112.stdout: 10 121866 14.43 MB/sec execute 326 sec latency 117.357 ms 2020-11-20T11:38:39.253 INFO:tasks.workunit.client.0.smithi112.stdout: 10 122062 14.41 MB/sec execute 327 sec latency 154.183 ms 2020-11-20T11:38:40.254 INFO:tasks.workunit.client.0.smithi112.stdout: 10 122280 14.41 MB/sec execute 328 sec latency 140.631 ms 2020-11-20T11:38:41.254 INFO:tasks.workunit.client.0.smithi112.stdout: 10 122582 14.43 MB/sec execute 329 sec latency 103.524 ms 2020-11-20T11:38:42.254 INFO:tasks.workunit.client.0.smithi112.stdout: 10 122941 14.45 MB/sec execute 330 sec latency 193.935 ms 2020-11-20T11:38:43.254 INFO:tasks.workunit.client.0.smithi112.stdout: 10 123262 14.43 MB/sec execute 331 sec latency 262.414 ms 2020-11-20T11:38:44.257 INFO:tasks.workunit.client.0.smithi112.stdout: 10 123573 14.43 MB/sec execute 332 sec latency 115.123 ms 2020-11-20T11:38:45.257 INFO:tasks.workunit.client.0.smithi112.stdout: 10 123833 14.44 MB/sec execute 333 sec latency 98.699 ms 2020-11-20T11:38:46.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 124142 14.47 MB/sec execute 334 sec latency 96.665 ms 2020-11-20T11:38:47.257 INFO:tasks.workunit.client.0.smithi112.stdout: 10 124372 14.47 MB/sec execute 335 sec latency 113.689 ms 2020-11-20T11:38:48.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 124598 14.48 MB/sec execute 336 sec latency 106.292 ms 2020-11-20T11:38:49.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 124816 14.48 MB/sec execute 337 sec latency 124.056 ms 2020-11-20T11:38:50.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 125068 14.46 MB/sec execute 338 sec latency 93.684 ms 2020-11-20T11:38:51.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 125317 14.43 MB/sec execute 339 sec latency 97.455 ms 2020-11-20T11:38:52.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 125515 14.41 MB/sec execute 340 sec latency 211.474 ms 2020-11-20T11:38:53.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 125671 14.39 MB/sec execute 341 sec latency 286.267 ms 2020-11-20T11:38:54.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 125932 14.39 MB/sec execute 342 sec latency 133.996 ms 2020-11-20T11:38:55.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 126376 14.44 MB/sec execute 343 sec latency 82.066 ms 2020-11-20T11:38:56.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 126717 14.44 MB/sec execute 344 sec latency 127.078 ms 2020-11-20T11:38:57.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 127041 14.43 MB/sec execute 345 sec latency 111.111 ms 2020-11-20T11:38:58.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 127324 14.45 MB/sec execute 346 sec latency 110.860 ms 2020-11-20T11:38:59.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 127645 14.47 MB/sec execute 347 sec latency 89.964 ms 2020-11-20T11:39:00.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 127871 14.47 MB/sec execute 348 sec latency 128.563 ms 2020-11-20T11:39:01.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 128108 14.48 MB/sec execute 349 sec latency 117.908 ms 2020-11-20T11:39:02.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 128313 14.48 MB/sec execute 350 sec latency 206.082 ms 2020-11-20T11:39:03.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 128552 14.46 MB/sec execute 351 sec latency 197.012 ms 2020-11-20T11:39:04.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 128782 14.43 MB/sec execute 352 sec latency 113.283 ms 2020-11-20T11:39:05.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 128969 14.41 MB/sec execute 353 sec latency 127.205 ms 2020-11-20T11:39:06.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 129158 14.40 MB/sec execute 354 sec latency 152.272 ms 2020-11-20T11:39:07.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 129377 14.39 MB/sec execute 355 sec latency 101.556 ms 2020-11-20T11:39:08.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 129662 14.41 MB/sec execute 356 sec latency 134.452 ms 2020-11-20T11:39:09.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 130042 14.42 MB/sec execute 357 sec latency 140.480 ms 2020-11-20T11:39:10.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 130375 14.42 MB/sec execute 358 sec latency 129.115 ms 2020-11-20T11:39:11.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 130675 14.41 MB/sec execute 359 sec latency 123.686 ms 2020-11-20T11:39:12.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 130910 14.43 MB/sec execute 360 sec latency 145.540 ms 2020-11-20T11:39:13.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 131218 14.45 MB/sec execute 361 sec latency 148.010 ms 2020-11-20T11:39:14.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 131452 14.45 MB/sec execute 362 sec latency 139.889 ms 2020-11-20T11:39:15.258 INFO:tasks.workunit.client.0.smithi112.stdout: 10 131659 14.46 MB/sec execute 363 sec latency 113.177 ms 2020-11-20T11:39:16.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 131869 14.46 MB/sec execute 364 sec latency 103.819 ms 2020-11-20T11:39:17.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 132121 14.43 MB/sec execute 365 sec latency 94.667 ms 2020-11-20T11:39:18.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 132331 14.40 MB/sec execute 366 sec latency 129.547 ms 2020-11-20T11:39:19.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 132551 14.38 MB/sec execute 367 sec latency 115.552 ms 2020-11-20T11:39:20.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 132772 14.38 MB/sec execute 368 sec latency 107.559 ms 2020-11-20T11:39:21.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 133061 14.38 MB/sec execute 369 sec latency 97.221 ms 2020-11-20T11:39:22.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 133377 14.40 MB/sec execute 370 sec latency 196.353 ms 2020-11-20T11:39:23.260 INFO:tasks.workunit.client.0.smithi112.stdout: 10 133736 14.41 MB/sec execute 371 sec latency 189.295 ms 2020-11-20T11:39:24.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 134056 14.40 MB/sec execute 372 sec latency 110.102 ms 2020-11-20T11:39:25.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 134380 14.42 MB/sec execute 373 sec latency 99.313 ms 2020-11-20T11:39:26.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 134677 14.43 MB/sec execute 374 sec latency 97.266 ms 2020-11-20T11:39:27.259 INFO:tasks.workunit.client.0.smithi112.stdout: 10 134886 14.43 MB/sec execute 375 sec latency 125.461 ms 2020-11-20T11:39:28.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 135142 14.44 MB/sec execute 376 sec latency 114.215 ms 2020-11-20T11:39:29.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 135357 14.45 MB/sec execute 377 sec latency 135.969 ms 2020-11-20T11:39:30.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 135577 14.44 MB/sec execute 378 sec latency 92.370 ms 2020-11-20T11:39:31.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 135818 14.41 MB/sec execute 379 sec latency 130.886 ms 2020-11-20T11:39:32.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 136026 14.39 MB/sec execute 380 sec latency 199.543 ms 2020-11-20T11:39:33.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 136201 14.38 MB/sec execute 381 sec latency 214.438 ms 2020-11-20T11:39:34.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 136440 14.37 MB/sec execute 382 sec latency 114.970 ms 2020-11-20T11:39:35.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 136736 14.38 MB/sec execute 383 sec latency 103.206 ms 2020-11-20T11:39:36.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 137090 14.41 MB/sec execute 384 sec latency 94.753 ms 2020-11-20T11:39:37.262 INFO:tasks.workunit.client.0.smithi112.stdout: 10 137482 14.40 MB/sec execute 385 sec latency 117.516 ms 2020-11-20T11:39:38.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 137762 14.39 MB/sec execute 386 sec latency 160.153 ms 2020-11-20T11:39:39.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 138076 14.42 MB/sec execute 387 sec latency 101.726 ms 2020-11-20T11:39:40.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 138338 14.43 MB/sec execute 388 sec latency 134.309 ms 2020-11-20T11:39:41.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 138625 14.44 MB/sec execute 389 sec latency 113.939 ms 2020-11-20T11:39:42.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 138833 14.45 MB/sec execute 390 sec latency 206.291 ms 2020-11-20T11:39:43.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 139049 14.44 MB/sec execute 391 sec latency 177.197 ms 2020-11-20T11:39:44.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 139322 14.42 MB/sec execute 392 sec latency 110.233 ms 2020-11-20T11:39:45.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 139552 14.40 MB/sec execute 393 sec latency 157.286 ms 2020-11-20T11:39:46.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 139764 14.39 MB/sec execute 394 sec latency 137.727 ms 2020-11-20T11:39:47.265 INFO:tasks.workunit.client.0.smithi112.stdout: 10 139993 14.39 MB/sec execute 395 sec latency 169.811 ms 2020-11-20T11:39:48.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 140246 14.40 MB/sec execute 396 sec latency 126.758 ms 2020-11-20T11:39:49.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 140606 14.41 MB/sec execute 397 sec latency 120.090 ms 2020-11-20T11:39:50.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 140913 14.40 MB/sec execute 398 sec latency 136.937 ms 2020-11-20T11:39:51.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 141271 14.40 MB/sec execute 399 sec latency 142.454 ms 2020-11-20T11:39:52.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 141501 14.40 MB/sec execute 400 sec latency 179.410 ms 2020-11-20T11:39:53.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 141725 14.41 MB/sec execute 401 sec latency 236.835 ms 2020-11-20T11:39:54.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 142018 14.42 MB/sec execute 402 sec latency 106.291 ms 2020-11-20T11:39:55.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 142300 14.44 MB/sec execute 403 sec latency 101.069 ms 2020-11-20T11:39:56.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 142515 14.44 MB/sec execute 404 sec latency 110.462 ms 2020-11-20T11:39:57.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 142818 14.43 MB/sec execute 405 sec latency 104.448 ms 2020-11-20T11:39:58.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 143018 14.40 MB/sec execute 406 sec latency 98.905 ms 2020-11-20T11:39:59.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 143259 14.40 MB/sec execute 407 sec latency 166.330 ms 2020-11-20T11:40:00.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 143470 14.39 MB/sec execute 408 sec latency 116.213 ms 2020-11-20T11:40:01.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 143696 14.39 MB/sec execute 409 sec latency 116.411 ms 2020-11-20T11:40:02.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 143949 14.39 MB/sec execute 410 sec latency 202.121 ms 2020-11-20T11:40:03.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 144271 14.40 MB/sec execute 411 sec latency 189.308 ms 2020-11-20T11:40:04.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 144550 14.38 MB/sec execute 412 sec latency 115.016 ms 2020-11-20T11:40:05.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 144882 14.39 MB/sec execute 413 sec latency 136.495 ms 2020-11-20T11:40:06.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 145121 14.39 MB/sec execute 414 sec latency 94.790 ms 2020-11-20T11:40:07.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 145371 14.40 MB/sec execute 415 sec latency 120.184 ms 2020-11-20T11:40:08.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 145631 14.41 MB/sec execute 416 sec latency 139.910 ms 2020-11-20T11:40:09.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 145928 14.44 MB/sec execute 417 sec latency 105.867 ms 2020-11-20T11:40:10.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 146130 14.42 MB/sec execute 418 sec latency 111.986 ms 2020-11-20T11:40:11.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 146408 14.40 MB/sec execute 419 sec latency 127.559 ms 2020-11-20T11:40:12.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 146596 14.39 MB/sec execute 420 sec latency 181.689 ms 2020-11-20T11:40:13.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 146785 14.37 MB/sec execute 421 sec latency 243.822 ms 2020-11-20T11:40:14.266 INFO:tasks.workunit.client.0.smithi112.stdout: 10 147013 14.36 MB/sec execute 422 sec latency 121.766 ms 2020-11-20T11:40:15.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 147271 14.37 MB/sec execute 423 sec latency 125.086 ms 2020-11-20T11:40:16.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 147607 14.38 MB/sec execute 424 sec latency 105.620 ms 2020-11-20T11:40:17.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 148012 14.39 MB/sec execute 425 sec latency 93.370 ms 2020-11-20T11:40:18.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 148344 14.38 MB/sec execute 426 sec latency 166.218 ms 2020-11-20T11:40:19.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 148649 14.40 MB/sec execute 427 sec latency 90.028 ms 2020-11-20T11:40:20.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 148913 14.41 MB/sec execute 428 sec latency 100.885 ms 2020-11-20T11:40:21.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 149174 14.42 MB/sec execute 429 sec latency 107.780 ms 2020-11-20T11:40:22.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 149401 14.42 MB/sec execute 430 sec latency 199.449 ms 2020-11-20T11:40:23.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 149616 14.42 MB/sec execute 431 sec latency 220.319 ms 2020-11-20T11:40:24.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 149908 14.41 MB/sec execute 432 sec latency 104.047 ms 2020-11-20T11:40:25.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 150110 14.39 MB/sec execute 433 sec latency 102.870 ms 2020-11-20T11:40:26.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 150313 14.38 MB/sec execute 434 sec latency 99.361 ms 2020-11-20T11:40:27.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 150496 14.36 MB/sec execute 435 sec latency 119.140 ms 2020-11-20T11:40:28.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 150729 14.37 MB/sec execute 436 sec latency 161.362 ms 2020-11-20T11:40:29.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 151041 14.38 MB/sec execute 437 sec latency 138.838 ms 2020-11-20T11:40:30.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 151439 14.39 MB/sec execute 438 sec latency 146.542 ms 2020-11-20T11:40:31.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 151747 14.37 MB/sec execute 439 sec latency 133.110 ms 2020-11-20T11:40:32.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 151974 14.37 MB/sec execute 440 sec latency 166.568 ms 2020-11-20T11:40:33.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 152263 14.39 MB/sec execute 441 sec latency 168.920 ms 2020-11-20T11:40:34.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 152557 14.40 MB/sec execute 442 sec latency 108.363 ms 2020-11-20T11:40:35.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 152829 14.41 MB/sec execute 443 sec latency 105.790 ms 2020-11-20T11:40:36.268 INFO:tasks.workunit.client.0.smithi112.stdout: 10 153063 14.42 MB/sec execute 444 sec latency 117.679 ms 2020-11-20T11:40:37.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 153317 14.41 MB/sec execute 445 sec latency 128.560 ms 2020-11-20T11:40:38.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 153556 14.39 MB/sec execute 446 sec latency 108.226 ms 2020-11-20T11:40:39.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 153798 14.39 MB/sec execute 447 sec latency 105.516 ms 2020-11-20T11:40:40.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 153997 14.37 MB/sec execute 448 sec latency 92.464 ms 2020-11-20T11:40:41.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 154236 14.37 MB/sec execute 449 sec latency 151.516 ms 2020-11-20T11:40:42.268 INFO:tasks.workunit.client.0.smithi112.stdout: 10 154425 14.37 MB/sec execute 450 sec latency 173.091 ms 2020-11-20T11:40:43.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 154756 14.38 MB/sec execute 451 sec latency 221.888 ms 2020-11-20T11:40:44.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 155103 14.37 MB/sec execute 452 sec latency 114.908 ms 2020-11-20T11:40:45.267 INFO:tasks.workunit.client.0.smithi112.stdout: 10 155398 14.37 MB/sec execute 453 sec latency 116.756 ms 2020-11-20T11:40:46.268 INFO:tasks.workunit.client.0.smithi112.stdout: 10 155672 14.37 MB/sec execute 454 sec latency 126.913 ms 2020-11-20T11:40:47.268 INFO:tasks.workunit.client.0.smithi112.stdout: 10 155854 14.36 MB/sec execute 455 sec latency 455.083 ms 2020-11-20T11:40:48.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 156083 14.37 MB/sec execute 456 sec latency 317.943 ms 2020-11-20T11:40:49.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 156391 14.39 MB/sec execute 457 sec latency 105.492 ms 2020-11-20T11:40:50.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 156652 14.40 MB/sec execute 458 sec latency 109.070 ms 2020-11-20T11:40:51.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 156942 14.39 MB/sec execute 459 sec latency 94.098 ms 2020-11-20T11:40:52.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 157141 14.37 MB/sec execute 460 sec latency 172.219 ms 2020-11-20T11:40:53.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 157330 14.37 MB/sec execute 461 sec latency 156.001 ms 2020-11-20T11:40:54.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 157545 14.36 MB/sec execute 462 sec latency 98.483 ms 2020-11-20T11:40:55.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 157768 14.35 MB/sec execute 463 sec latency 110.237 ms 2020-11-20T11:40:56.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 158008 14.35 MB/sec execute 464 sec latency 139.325 ms 2020-11-20T11:40:57.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 158328 14.37 MB/sec execute 465 sec latency 112.598 ms 2020-11-20T11:40:58.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 158706 14.36 MB/sec execute 466 sec latency 142.525 ms 2020-11-20T11:40:59.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 159037 14.35 MB/sec execute 467 sec latency 110.332 ms 2020-11-20T11:41:00.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 159306 14.36 MB/sec execute 468 sec latency 111.368 ms 2020-11-20T11:41:01.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 159558 14.37 MB/sec execute 469 sec latency 107.137 ms 2020-11-20T11:41:02.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 159839 14.38 MB/sec execute 470 sec latency 192.417 ms 2020-11-20T11:41:03.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 160153 14.40 MB/sec execute 471 sec latency 176.668 ms 2020-11-20T11:41:04.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 160396 14.40 MB/sec execute 472 sec latency 106.924 ms 2020-11-20T11:41:05.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 160663 14.38 MB/sec execute 473 sec latency 112.590 ms 2020-11-20T11:41:06.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 160870 14.37 MB/sec execute 474 sec latency 76.722 ms 2020-11-20T11:41:07.272 INFO:tasks.workunit.client.0.smithi112.stdout: 10 161085 14.37 MB/sec execute 475 sec latency 143.549 ms 2020-11-20T11:41:08.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 161294 14.36 MB/sec execute 476 sec latency 181.399 ms 2020-11-20T11:41:09.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 161523 14.36 MB/sec execute 477 sec latency 129.927 ms 2020-11-20T11:41:10.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 161822 14.36 MB/sec execute 478 sec latency 117.160 ms 2020-11-20T11:41:11.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 162195 14.36 MB/sec execute 479 sec latency 92.403 ms 2020-11-20T11:41:12.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 162482 14.36 MB/sec execute 480 sec latency 138.339 ms 2020-11-20T11:41:13.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 162728 14.35 MB/sec execute 481 sec latency 186.772 ms 2020-11-20T11:41:14.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163000 14.37 MB/sec execute 482 sec latency 217.261 ms 2020-11-20T11:41:15.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163139 14.35 MB/sec execute 483 sec latency 242.270 ms 2020-11-20T11:41:16.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163308 14.34 MB/sec execute 484 sec latency 166.116 ms 2020-11-20T11:41:17.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163544 14.37 MB/sec execute 485 sec latency 162.813 ms 2020-11-20T11:41:18.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163696 14.35 MB/sec execute 486 sec latency 253.682 ms 2020-11-20T11:41:19.273 INFO:tasks.workunit.client.0.smithi112.stdout: 10 163922 14.34 MB/sec execute 487 sec latency 142.591 ms 2020-11-20T11:41:20.274 INFO:tasks.workunit.client.0.smithi112.stdout: 10 164188 14.33 MB/sec execute 488 sec latency 86.872 ms 2020-11-20T11:41:21.274 INFO:tasks.workunit.client.0.smithi112.stdout: 10 164329 14.31 MB/sec execute 489 sec latency 124.830 ms 2020-11-20T11:41:22.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 164542 14.31 MB/sec execute 490 sec latency 175.006 ms 2020-11-20T11:41:23.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 164683 14.29 MB/sec execute 491 sec latency 309.496 ms 2020-11-20T11:41:24.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 164802 14.27 MB/sec execute 492 sec latency 232.826 ms 2020-11-20T11:41:25.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 165011 14.26 MB/sec execute 493 sec latency 196.726 ms 2020-11-20T11:41:26.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 165264 14.27 MB/sec execute 494 sec latency 175.685 ms 2020-11-20T11:41:27.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 165550 14.28 MB/sec execute 495 sec latency 148.649 ms 2020-11-20T11:41:28.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 165815 14.26 MB/sec execute 496 sec latency 251.701 ms 2020-11-20T11:41:29.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 166156 14.26 MB/sec execute 497 sec latency 100.801 ms 2020-11-20T11:41:30.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 166313 14.25 MB/sec execute 498 sec latency 124.137 ms 2020-11-20T11:41:31.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 166529 14.26 MB/sec execute 499 sec latency 164.551 ms 2020-11-20T11:41:32.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 166724 14.26 MB/sec execute 500 sec latency 222.312 ms 2020-11-20T11:41:33.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 166944 14.25 MB/sec execute 501 sec latency 309.173 ms 2020-11-20T11:41:34.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 167238 14.28 MB/sec execute 502 sec latency 179.833 ms 2020-11-20T11:41:35.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 167412 14.27 MB/sec execute 503 sec latency 195.141 ms 2020-11-20T11:41:36.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 167685 14.25 MB/sec execute 504 sec latency 222.048 ms 2020-11-20T11:41:37.276 INFO:tasks.workunit.client.0.smithi112.stdout: 10 167881 14.24 MB/sec execute 505 sec latency 124.429 ms 2020-11-20T11:41:38.277 INFO:tasks.workunit.client.0.smithi112.stdout: 10 168139 14.24 MB/sec execute 506 sec latency 74.497 ms 2020-11-20T11:41:39.277 INFO:tasks.workunit.client.0.smithi112.stdout: 10 168378 14.23 MB/sec execute 507 sec latency 92.528 ms 2020-11-20T11:41:40.277 INFO:tasks.workunit.client.0.smithi112.stdout: 10 168653 14.23 MB/sec execute 508 sec latency 117.170 ms 2020-11-20T11:41:41.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 168866 14.23 MB/sec execute 509 sec latency 137.070 ms 2020-11-20T11:41:42.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 169139 14.24 MB/sec execute 510 sec latency 185.068 ms 2020-11-20T11:41:43.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 169292 14.22 MB/sec execute 511 sec latency 327.691 ms 2020-11-20T11:41:44.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 169589 14.20 MB/sec execute 512 sec latency 350.762 ms 2020-11-20T11:41:45.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 169860 14.20 MB/sec execute 513 sec latency 143.997 ms 2020-11-20T11:41:46.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 170044 14.20 MB/sec execute 514 sec latency 149.172 ms 2020-11-20T11:41:47.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 170278 14.21 MB/sec execute 515 sec latency 144.749 ms 2020-11-20T11:41:48.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 170574 14.22 MB/sec execute 516 sec latency 121.188 ms 2020-11-20T11:41:49.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 170834 14.24 MB/sec execute 517 sec latency 214.943 ms 2020-11-20T11:41:50.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171019 14.22 MB/sec execute 518 sec latency 254.861 ms 2020-11-20T11:41:51.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171266 14.21 MB/sec execute 519 sec latency 125.415 ms 2020-11-20T11:41:52.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171408 14.19 MB/sec execute 520 sec latency 145.505 ms 2020-11-20T11:41:53.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171613 14.20 MB/sec execute 521 sec latency 200.153 ms 2020-11-20T11:41:54.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171808 14.18 MB/sec execute 522 sec latency 158.961 ms 2020-11-20T11:41:55.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 171986 14.17 MB/sec execute 523 sec latency 167.146 ms 2020-11-20T11:41:56.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 172184 14.16 MB/sec execute 524 sec latency 165.645 ms 2020-11-20T11:41:57.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 172475 14.17 MB/sec execute 525 sec latency 119.571 ms 2020-11-20T11:41:58.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 172822 14.18 MB/sec execute 526 sec latency 127.445 ms 2020-11-20T11:41:59.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 173230 14.17 MB/sec execute 527 sec latency 104.555 ms 2020-11-20T11:42:00.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 173435 14.16 MB/sec execute 528 sec latency 92.405 ms 2020-11-20T11:42:01.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 173702 14.18 MB/sec execute 529 sec latency 144.143 ms 2020-11-20T11:42:02.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 173953 14.19 MB/sec execute 530 sec latency 176.721 ms 2020-11-20T11:42:03.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 174276 14.21 MB/sec execute 531 sec latency 254.396 ms 2020-11-20T11:42:04.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 174573 14.21 MB/sec execute 532 sec latency 146.708 ms 2020-11-20T11:42:05.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 174806 14.20 MB/sec execute 533 sec latency 122.579 ms 2020-11-20T11:42:06.280 INFO:tasks.workunit.client.0.smithi112.stdout: 10 175031 14.19 MB/sec execute 534 sec latency 104.746 ms 2020-11-20T11:42:07.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 175269 14.19 MB/sec execute 535 sec latency 120.510 ms 2020-11-20T11:42:08.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 175486 14.18 MB/sec execute 536 sec latency 129.704 ms 2020-11-20T11:42:09.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 175729 14.18 MB/sec execute 537 sec latency 144.339 ms 2020-11-20T11:42:10.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 175962 14.18 MB/sec execute 538 sec latency 107.488 ms 2020-11-20T11:42:11.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 176344 14.19 MB/sec execute 539 sec latency 148.526 ms 2020-11-20T11:42:12.282 INFO:tasks.workunit.client.0.smithi112.stdout: 10 176672 14.18 MB/sec execute 540 sec latency 186.593 ms 2020-11-20T11:42:13.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 176899 14.17 MB/sec execute 541 sec latency 223.186 ms 2020-11-20T11:42:14.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 177157 14.17 MB/sec execute 542 sec latency 108.269 ms 2020-11-20T11:42:15.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 177428 14.18 MB/sec execute 543 sec latency 109.763 ms 2020-11-20T11:42:16.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 177683 14.19 MB/sec execute 544 sec latency 125.700 ms 2020-11-20T11:42:17.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 177988 14.20 MB/sec execute 545 sec latency 100.107 ms 2020-11-20T11:42:18.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 178252 14.20 MB/sec execute 546 sec latency 127.279 ms 2020-11-20T11:42:19.281 INFO:tasks.workunit.client.0.smithi112.stdout: 10 178422 14.19 MB/sec execute 547 sec latency 139.770 ms 2020-11-20T11:42:20.284 INFO:tasks.workunit.client.0.smithi112.stdout: 10 178604 14.18 MB/sec execute 548 sec latency 119.575 ms 2020-11-20T11:42:21.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 178810 14.18 MB/sec execute 549 sec latency 150.657 ms 2020-11-20T11:42:22.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 178989 14.16 MB/sec execute 550 sec latency 201.170 ms 2020-11-20T11:42:23.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 179138 14.15 MB/sec execute 551 sec latency 401.353 ms 2020-11-20T11:42:24.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 179342 14.15 MB/sec execute 552 sec latency 173.041 ms 2020-11-20T11:42:25.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 179549 14.15 MB/sec execute 553 sec latency 125.919 ms 2020-11-20T11:42:26.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 179899 14.15 MB/sec execute 554 sec latency 144.450 ms 2020-11-20T11:42:27.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 180255 14.14 MB/sec execute 555 sec latency 153.434 ms 2020-11-20T11:42:28.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 180508 14.14 MB/sec execute 556 sec latency 145.783 ms 2020-11-20T11:42:29.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 180751 14.15 MB/sec execute 557 sec latency 149.860 ms 2020-11-20T11:42:30.285 INFO:tasks.workunit.client.0.smithi112.stdout: 10 181069 14.16 MB/sec execute 558 sec latency 103.221 ms 2020-11-20T11:42:31.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 181401 14.18 MB/sec execute 559 sec latency 101.084 ms 2020-11-20T11:42:32.287 INFO:tasks.workunit.client.0.smithi112.stdout: 10 181659 14.18 MB/sec execute 560 sec latency 142.692 ms 2020-11-20T11:42:33.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 181884 14.17 MB/sec execute 561 sec latency 112.810 ms 2020-11-20T11:42:34.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 182075 14.16 MB/sec execute 562 sec latency 182.187 ms 2020-11-20T11:42:35.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 182316 14.16 MB/sec execute 563 sec latency 85.296 ms 2020-11-20T11:42:36.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 182561 14.16 MB/sec execute 564 sec latency 116.167 ms 2020-11-20T11:42:37.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 182766 14.15 MB/sec execute 565 sec latency 118.419 ms 2020-11-20T11:42:38.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 183013 14.14 MB/sec execute 566 sec latency 123.486 ms 2020-11-20T11:42:39.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 183295 14.14 MB/sec execute 567 sec latency 136.235 ms 2020-11-20T11:42:40.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 183629 14.15 MB/sec execute 568 sec latency 99.307 ms 2020-11-20T11:42:41.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 183927 14.14 MB/sec execute 569 sec latency 187.416 ms 2020-11-20T11:42:42.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 184170 14.14 MB/sec execute 570 sec latency 177.455 ms 2020-11-20T11:42:43.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 184411 14.14 MB/sec execute 571 sec latency 201.161 ms 2020-11-20T11:42:44.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 184749 14.16 MB/sec execute 572 sec latency 97.199 ms 2020-11-20T11:42:45.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 185109 14.18 MB/sec execute 573 sec latency 127.242 ms 2020-11-20T11:42:46.287 INFO:tasks.workunit.client.0.smithi112.stdout: 10 185328 14.17 MB/sec execute 574 sec latency 103.057 ms 2020-11-20T11:42:47.286 INFO:tasks.workunit.client.0.smithi112.stdout: 10 185557 14.17 MB/sec execute 575 sec latency 97.576 ms 2020-11-20T11:42:48.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 185754 14.16 MB/sec execute 576 sec latency 104.934 ms 2020-11-20T11:42:49.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 185999 14.16 MB/sec execute 577 sec latency 107.760 ms 2020-11-20T11:42:50.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 186223 14.15 MB/sec execute 578 sec latency 120.628 ms 2020-11-20T11:42:51.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 186398 14.15 MB/sec execute 579 sec latency 176.385 ms 2020-11-20T11:42:52.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 186510 14.13 MB/sec execute 580 sec latency 219.010 ms 2020-11-20T11:42:53.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 186654 14.12 MB/sec execute 581 sec latency 310.561 ms 2020-11-20T11:42:54.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 186985 14.12 MB/sec execute 582 sec latency 134.505 ms 2020-11-20T11:42:55.298 INFO:tasks.workunit.client.0.smithi112.stdout: 10 187222 14.11 MB/sec execute 583 sec latency 241.747 ms 2020-11-20T11:42:57.810 INFO:tasks.workunit.client.0.smithi112.stdout: 10 187539 14.11 MB/sec execute 584 sec latency 111.464 ms 2020-11-20T11:42:57.810 INFO:tasks.workunit.client.0.smithi112.stdout: 10 187816 14.11 MB/sec execute 585 sec latency 105.006 ms 2020-11-20T11:42:58.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 188071 14.13 MB/sec execute 586 sec latency 100.534 ms 2020-11-20T11:42:59.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 188433 14.14 MB/sec execute 587 sec latency 117.698 ms 2020-11-20T11:43:00.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 188724 14.15 MB/sec execute 588 sec latency 184.977 ms 2020-11-20T11:43:01.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 188921 14.14 MB/sec execute 589 sec latency 106.686 ms 2020-11-20T11:43:02.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 189153 14.14 MB/sec execute 590 sec latency 177.559 ms 2020-11-20T11:43:03.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 189329 14.13 MB/sec execute 591 sec latency 238.967 ms 2020-11-20T11:43:04.292 INFO:tasks.workunit.client.0.smithi112.stdout: 10 189585 14.13 MB/sec execute 592 sec latency 133.279 ms 2020-11-20T11:43:05.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 189795 14.12 MB/sec execute 593 sec latency 126.415 ms 2020-11-20T11:43:06.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 190027 14.11 MB/sec execute 594 sec latency 141.760 ms 2020-11-20T11:43:07.288 INFO:tasks.workunit.client.0.smithi112.stdout: 10 190349 14.12 MB/sec execute 595 sec latency 102.417 ms 2020-11-20T11:43:08.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 190693 14.12 MB/sec execute 596 sec latency 135.808 ms 2020-11-20T11:43:09.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 191024 14.12 MB/sec execute 597 sec latency 116.737 ms 2020-11-20T11:43:10.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 191274 14.12 MB/sec execute 598 sec latency 156.845 ms 2020-11-20T11:43:11.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 191438 14.12 MB/sec execute 599 sec latency 211.862 ms 2020-11-20T11:43:12.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 cleanup 600 sec 2020-11-20T11:43:13.289 INFO:tasks.workunit.client.0.smithi112.stdout: 10 cleanup 601 sec 2020-11-20T11:43:14.289 INFO:tasks.workunit.client.0.smithi112.stdout: 5 cleanup 602 sec 2020-11-20T11:43:14.463 INFO:tasks.workunit.client.0.smithi112.stdout: 0 cleanup 602 sec 2020-11-20T11:43:14.463 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:43:14.464 INFO:tasks.workunit.client.0.smithi112.stdout: Operation Count AvgLat MaxLat 2020-11-20T11:43:14.464 INFO:tasks.workunit.client.0.smithi112.stdout: ---------------------------------------- 2020-11-20T11:43:14.464 INFO:tasks.workunit.client.0.smithi112.stdout: NTCreateX 271262 8.421 671.005 2020-11-20T11:43:14.465 INFO:tasks.workunit.client.0.smithi112.stdout: Close 199056 0.003 26.777 2020-11-20T11:43:14.465 INFO:tasks.workunit.client.0.smithi112.stdout: Rename 11525 40.628 641.007 2020-11-20T11:43:14.465 INFO:tasks.workunit.client.0.smithi112.stdout: Unlink 54919 9.043 135.303 2020-11-20T11:43:14.465 INFO:tasks.workunit.client.0.smithi112.stdout: Qpathinfo 246004 7.348 673.183 2020-11-20T11:43:14.465 INFO:tasks.workunit.client.0.smithi112.stdout: Qfileinfo 42924 0.001 0.033 2020-11-20T11:43:14.466 INFO:tasks.workunit.client.0.smithi112.stdout: Qfsinfo 45199 0.644 421.001 2020-11-20T11:43:14.466 INFO:tasks.workunit.client.0.smithi112.stdout: Sfileinfo 22133 0.654 239.995 2020-11-20T11:43:14.466 INFO:tasks.workunit.client.0.smithi112.stdout: Find 95125 0.502 192.126 2020-11-20T11:43:14.466 INFO:tasks.workunit.client.0.smithi112.stdout: WriteX 134143 0.514 337.554 2020-11-20T11:43:14.467 INFO:tasks.workunit.client.0.smithi112.stdout: ReadX 426395 0.123 444.442 2020-11-20T11:43:14.467 INFO:tasks.workunit.client.0.smithi112.stdout: LockX 890 8.982 61.008 2020-11-20T11:43:14.467 INFO:tasks.workunit.client.0.smithi112.stdout: UnlockX 890 7.725 57.269 2020-11-20T11:43:14.467 INFO:tasks.workunit.client.0.smithi112.stdout: Flush 19038 37.510 546.007 2020-11-20T11:43:14.467 INFO:tasks.workunit.client.0.smithi112.stdout: 2020-11-20T11:43:14.468 INFO:tasks.workunit.client.0.smithi112.stdout:Throughput 14.1164 MB/sec 10 clients 10 procs max_latency=673.193 ms 2020-11-20T11:43:14.564 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T11:43:14.564 INFO:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T11:43:17.136 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2020-11-20T11:43:17.137 INFO:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T11:43:21.067 DEBUG:teuthology.parallel:result is None 2020-11-20T11:43:21.069 INFO:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T11:43:21.115 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T11:43:21.116 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2020-11-20T11:43:21.128 INFO:tasks.kclient:Unmounting kernel clients... 2020-11-20T11:43:21.128 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2020-11-20T11:43:21.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:43:21.129 INFO:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2020-11-20T11:43:27.239 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:43:27.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:43:27.240 INFO:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:43:27.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:43:27.303 INFO:teuthology.orchestra.run.smithi112:> ip netns list 2020-11-20T11:43:28.348 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T11:43:28.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:43:28.349 INFO:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:43:28.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:43:28.420 INFO:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2020-11-20T11:43:28.539 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T11:43:28.573 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T11:43:28.573 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:43:34.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.572+0000 7fd84c066700 1 Processor -- start 2020-11-20T11:43:34.576 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.572+0000 7fd84c066700 1 -- start start 2020-11-20T11:43:34.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd84c066700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd844066110 0x7fd8440bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd84c066700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8441512e0 0x7fd844151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd84c066700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440c5230 con 0x7fd844065d30 2020-11-20T11:43:34.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd84c066700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440bff40 con 0x7fd844066110 2020-11-20T11:43:34.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd84c066700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8441549c0 con 0x7fd8441512e0 2020-11-20T11:43:34.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd849601700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd844066110 0x7fd8440bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.582 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd849601700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd844066110 0x7fd8440bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51336/0 (socket says 172.21.15.112:51336) 2020-11-20T11:43:34.582 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.573+0000 7fd849601700 1 -- 172.21.15.112:0/122214987 learned_addr learned my addr 172.21.15.112:0/122214987 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:34.582 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84a603700 1 --2- 172.21.15.112:0/122214987 >> v2:172.21.15.204:3300/0 conn(0x7fd8441512e0 0x7fd844151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.583 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd849601700 1 -- 172.21.15.112:0/122214987 >> v2:172.21.15.204:3300/0 conn(0x7fd8441512e0 msgr2=0x7fd844151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:34.583 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd849601700 1 --2- 172.21.15.112:0/122214987 >> v2:172.21.15.204:3300/0 conn(0x7fd8441512e0 0x7fd844151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.583 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd849601700 1 -- 172.21.15.112:0/122214987 >> v1:172.21.15.204:6789/0 conn(0x7fd844065d30 legacy=0x7fd8440c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:34.584 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd849601700 1 -- 172.21.15.112:0/122214987 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844154c60 con 0x7fd844066110 2020-11-20T11:43:34.584 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd849601700 1 --2- 172.21.15.112:0/122214987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd844066110 0x7fd8440bfa50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd8441548b0 tx=0x7fd834006ef0).ready entity=mon.0 client_cookie=60469433723e9abd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.584 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd848e00700 1 -- 172.21.15.112:0/122214987 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400b820 con 0x7fd844066110 2020-11-20T11:43:34.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd848e00700 1 -- 172.21.15.112:0/122214987 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834000e90 con 0x7fd844066110 2020-11-20T11:43:34.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd848e00700 1 -- 172.21.15.112:0/122214987 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400bb90 con 0x7fd844066110 2020-11-20T11:43:34.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 -- 172.21.15.112:0/122214987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd844066110 msgr2=0x7fd8440bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 --2- 172.21.15.112:0/122214987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd844066110 0x7fd8440bfa50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd8441548b0 tx=0x7fd834006ef0).stop 2020-11-20T11:43:34.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 -- 172.21.15.112:0/122214987 shutdown_connections 2020-11-20T11:43:34.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 --2- 172.21.15.112:0/122214987 >> v2:172.21.15.204:3300/0 conn(0x7fd8441512e0 0x7fd844151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 --2- 172.21.15.112:0/122214987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd844066110 0x7fd8440bfa50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 -- 172.21.15.112:0/122214987 >> 172.21.15.112:0/122214987 conn(0x7fd84405bac0 msgr2=0x7fd84405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:34.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 -- 172.21.15.112:0/122214987 shutdown_connections 2020-11-20T11:43:34.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.574+0000 7fd84c066700 1 -- 172.21.15.112:0/122214987 wait complete. 2020-11-20T11:43:34.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 Processor -- start 2020-11-20T11:43:34.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 -- start start 2020-11-20T11:43:34.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 0x7fd844164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd844066110 0x7fd8440b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844164f00 con 0x7fd8441512e0 2020-11-20T11:43:34.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844160c20 con 0x7fd844065d30 2020-11-20T11:43:34.593 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.576+0000 7fd84c066700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844160ec0 con 0x7fd844066110 2020-11-20T11:43:34.593 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.593 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51342/0 (socket says 172.21.15.112:51342) 2020-11-20T11:43:34.593 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd849601700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd844066110 0x7fd8440b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 -- 172.21.15.112:0/1876023421 learned_addr learned my addr 172.21.15.112:0/1876023421 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:34.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd849e02700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 0x7fd844164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 -- 172.21.15.112:0/1876023421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd844066110 msgr2=0x7fd8440b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd844066110 0x7fd8440b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.594 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 -- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 msgr2=0x7fd844164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 0x7fd844164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 -- 172.21.15.112:0/1876023421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844161160 con 0x7fd8441512e0 2020-11-20T11:43:34.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd849e02700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 0x7fd844164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:34.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84a603700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd83c00ebf0 tx=0x7fd83c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.595 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00c710 con 0x7fd8441512e0 2020-11-20T11:43:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00c870 con 0x7fd8441512e0 2020-11-20T11:43:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd844161400 con 0x7fd8441512e0 2020-11-20T11:43:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00cc30 con 0x7fd8441512e0 2020-11-20T11:43:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.577+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd844152950 con 0x7fd8441512e0 2020-11-20T11:43:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.578+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844161860 con 0x7fd8441512e0 2020-11-20T11:43:34.597 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.579+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd83c01d460 con 0x7fd8441512e0 2020-11-20T11:43:34.597 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.579+0000 7fd831ffb700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 0x7fd81c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.597 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.579+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd83c0a2990 con 0x7fd8441512e0 2020-11-20T11:43:34.597 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.580+0000 7fd849e02700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 0x7fd81c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.598 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.583+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd83c077340 con 0x7fd8441512e0 2020-11-20T11:43:34.598 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.590+0000 7fd849e02700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 0x7fd81c082b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd84000b740 tx=0x7fd840008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.729 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.726+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd844065740 con 0x7fd8441512e0 2020-11-20T11:43:34.731 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.727+0000 7fd831ffb700 1 -- 172.21.15.112:0/1876023421 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7fd83c07a960 con 0x7fd8441512e0 2020-11-20T11:43:34.731 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:43:34.731 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:43:34.732 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 msgr2=0x7fd81c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.733 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 0x7fd81c082b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd84000b740 tx=0x7fd840008040).stop 2020-11-20T11:43:34.733 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 msgr2=0x7fd84414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.733 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd83c00ebf0 tx=0x7fd83c008040).stop 2020-11-20T11:43:34.733 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 shutdown_connections 2020-11-20T11:43:34.734 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fd81c080670 0x7fd81c082b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.734 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8441512e0 0x7fd84414ebd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.734 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd844065d30 0x7fd844164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.734 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 --2- 172.21.15.112:0/1876023421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd844066110 0x7fd8440b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.734 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 >> 172.21.15.112:0/1876023421 conn(0x7fd84405bac0 msgr2=0x7fd8440c1350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:34.735 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 shutdown_connections 2020-11-20T11:43:34.735 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.729+0000 7fd84c066700 1 -- 172.21.15.112:0/1876023421 wait complete. 2020-11-20T11:43:34.744 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:43:34.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.852+0000 7efdebb0e700 1 Processor -- start 2020-11-20T11:43:34.856 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.852+0000 7efdebb0e700 1 -- start start 2020-11-20T11:43:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efdebb0e700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efde4065d30 0x7efde4066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efdebb0e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40c5230 con 0x7efde40bfa50 2020-11-20T11:43:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efdebb0e700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde41549c0 con 0x7efde41512e0 2020-11-20T11:43:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efdebb0e700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde4154c60 con 0x7efde4065d30 2020-11-20T11:43:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efde98aa700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efde4065d30 0x7efde4066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efde90a9700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7efde40bfa50 0x7efde40c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:46194/0 (socket says 172.21.15.112:46194) 2020-11-20T11:43:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efde90a9700 1 -- 172.21.15.112:0/3592763471 learned_addr learned my addr 172.21.15.112:0/3592763471 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.853+0000 7efde98aa700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efde4065d30 0x7efde4066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:37124/0 (socket says 172.21.15.112:37124) 2020-11-20T11:43:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678133976 0 0) 0x7efde41549c0 con 0x7efde41512e0 2020-11-20T11:43:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc003280 con 0x7efde41512e0 2020-11-20T11:43:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272061244 0 0) 0x7efde40c5230 con 0x7efde40bfa50 2020-11-20T11:43:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde98aa700 1 -- 172.21.15.112:0/3592763471 >> v1:172.21.15.204:6789/0 conn(0x7efde41512e0 legacy=0x7efde4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde98aa700 1 -- 172.21.15.112:0/3592763471 >> v1:172.21.15.166:6789/0 conn(0x7efde40bfa50 legacy=0x7efde40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde98aa700 1 -- 172.21.15.112:0/3592763471 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4154f00 con 0x7efde4065d30 2020-11-20T11:43:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde98aa700 1 --2- 172.21.15.112:0/3592763471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4066110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efde0006fd0 tx=0x7efde0006e30).ready entity=mon.2 client_cookie=74ffaa8e262fb74d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000bec0 con 0x7efde4065d30 2020-11-20T11:43:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0000e90 con 0x7efde4065d30 2020-11-20T11:43:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efde88a8700 1 -- 172.21.15.112:0/3592763471 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00099f0 con 0x7efde4065d30 2020-11-20T11:43:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 -- 172.21.15.112:0/3592763471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 msgr2=0x7efde4066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 --2- 172.21.15.112:0/3592763471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4066110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efde0006fd0 tx=0x7efde0006e30).stop 2020-11-20T11:43:34.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 -- 172.21.15.112:0/3592763471 shutdown_connections 2020-11-20T11:43:34.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 --2- 172.21.15.112:0/3592763471 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4066110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 -- 172.21.15.112:0/3592763471 >> 172.21.15.112:0/3592763471 conn(0x7efde405bac0 msgr2=0x7efde405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:34.863 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 -- 172.21.15.112:0/3592763471 shutdown_connections 2020-11-20T11:43:34.864 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.854+0000 7efdebb0e700 1 -- 172.21.15.112:0/3592763471 wait complete. 2020-11-20T11:43:34.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.855+0000 7efdebb0e700 1 Processor -- start 2020-11-20T11:43:34.866 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 -- start start 2020-11-20T11:43:34.867 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efde40bfa50 0x7efde414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde41512e0 0x7efde40b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde4061320 con 0x7efde41512e0 2020-11-20T11:43:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde4161660 con 0x7efde40bfa50 2020-11-20T11:43:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdebb0e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde4161c60 con 0x7efde4065d30 2020-11-20T11:43:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efde98aa700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efdea0ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde41512e0 0x7efde40b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efde98aa700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:37126/0 (socket says 172.21.15.112:37126) 2020-11-20T11:43:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efde98aa700 1 -- 172.21.15.112:0/1163654782 learned_addr learned my addr 172.21.15.112:0/1163654782 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.856+0000 7efde90a9700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efde40bfa50 0x7efde414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 -- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efde40bfa50 msgr2=0x7efde414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efde40bfa50 0x7efde414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 -- 172.21.15.112:0/1163654782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde41512e0 msgr2=0x7efde40b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde41512e0 0x7efde40b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 -- 172.21.15.112:0/1163654782 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4161f00 con 0x7efde4065d30 2020-11-20T11:43:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efde98aa700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7efde0009340 tx=0x7efde0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00099b0 con 0x7efde4065d30 2020-11-20T11:43:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0011a70 con 0x7efde4065d30 2020-11-20T11:43:34.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0011df0 con 0x7efde4065d30 2020-11-20T11:43:34.873 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde41621a0 con 0x7efde4065d30 2020-11-20T11:43:34.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.857+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde4162980 con 0x7efde4065d30 2020-11-20T11:43:34.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.858+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde4162b80 con 0x7efde4065d30 2020-11-20T11:43:34.874 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.859+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efde0025030 con 0x7efde4065d30 2020-11-20T11:43:34.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.859+0000 7efdd1ffb700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 0x7efdbc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:34.875 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.859+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7efde00a4300 con 0x7efde4065d30 2020-11-20T11:43:34.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.859+0000 7efde90a9700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 0x7efdbc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:34.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.860+0000 7efde90a9700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 0x7efdbc082b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efde4153380 tx=0x7efdd4007c40).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:34.876 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:34.862+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mon.2 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efde0078d10 con 0x7efde4065d30 2020-11-20T11:43:35.004 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.001+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efde4065740 con 0x7efdbc080670 2020-11-20T11:43:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.021+0000 7efdd1ffb700 1 -- 172.21.15.112:0/1163654782 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149491 (secure 0 0 0) 0x7efde4065740 con 0x7efdbc080670 2020-11-20T11:43:35.026 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:43:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 msgr2=0x7efdbc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 0x7efdbc082b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efde4153380 tx=0x7efdd4007c40).stop 2020-11-20T11:43:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 msgr2=0x7efde4161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.028 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7efde0009340 tx=0x7efde0015000).stop 2020-11-20T11:43:35.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 shutdown_connections 2020-11-20T11:43:35.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7efdbc080670 0x7efdbc082b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde41512e0 0x7efde40b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.029 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde4065d30 0x7efde4161170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 --2- 172.21.15.112:0/1163654782 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efde40bfa50 0x7efde414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 >> 172.21.15.112:0/1163654782 conn(0x7efde405bac0 msgr2=0x7efde40c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:35.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 shutdown_connections 2020-11-20T11:43:35.030 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.023+0000 7efdebb0e700 1 -- 172.21.15.112:0/1163654782 wait complete. 2020-11-20T11:43:35.030 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:43:35.038 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":791,"stamp":"2020-11-20T11:43:34.395319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":303806550,"num_objects":655,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":655,"num_whiteouts":0,"num_read":19623,"num_read_kb":1133421,"num_write":313771,"num_write_kb":6511382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160948,"ondisk_log_size":160948,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":4035984,"kb_used_data":637684,"kb_used_omap":0,"kb_used_meta":3397952,"kb_avail":1128426096,"statfs":{"total":1159641169920,"available":1155508322304,"internally_reserved":0,"allocated":652988416,"data_stored":650948426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3479502848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,5,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-98193518,"num_objects":-884,"num_object_clones":0,"num_object_copies":-3470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-884,"num_whiteouts":0,"num_read":5,"num_read_kb":135,"num_write":950,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"4.2","version":"29'27735","reported_seq":"28937","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:32.051787+0000","last_change":"2020-11-20T11:18:02.984319+0000","last_active":"2020-11-20T11:43:32.051787+0000","last_peered":"2020-11-20T11:43:32.051787+0000","last_clean":"2020-11-20T11:43:32.051787+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:43:32.051787+0000","last_undegraded":"2020-11-20T11:43:32.051787+0000","last_fullsized":"2020-11-20T11:43:32.051787+0000","mapping_epoch":27,"log_start":"29'17644","ondisk_log_start":"29'17644","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10091,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5839135,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":1191,"num_read_kb":78290,"num_write":20408,"num_write_kb":728019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725498+0000","last_change":"2020-11-20T11:17:56.684598+0000","last_active":"2020-11-20T11:18:02.725498+0000","last_peered":"2020-11-20T11:18:02.725498+0000","last_clean":"2020-11-20T11:18:02.725498+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:18:02.725498+0000","last_undegraded":"2020-11-20T11:18:02.725498+0000","last_fullsized":"2020-11-20T11:18:02.725498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'23426","reported_seq":"23437","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:22.163014+0000","last_change":"2020-11-20T11:17:59.712095+0000","last_active":"2020-11-20T11:43:22.163014+0000","last_peered":"2020-11-20T11:43:22.163014+0000","last_clean":"2020-11-20T11:43:22.163014+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:43:22.163014+0000","last_undegraded":"2020-11-20T11:43:22.163014+0000","last_fullsized":"2020-11-20T11:43:22.163014+0000","mapping_epoch":24,"log_start":"29'13400","ondisk_log_start":"29'13400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10026,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360288,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":23457,"num_write_kb":165858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"29'27700","reported_seq":"29853","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:32.950960+0000","last_change":"2020-11-20T11:18:02.983813+0000","last_active":"2020-11-20T11:43:32.950960+0000","last_peered":"2020-11-20T11:43:32.950960+0000","last_clean":"2020-11-20T11:43:32.950960+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:43:32.950960+0000","last_undegraded":"2020-11-20T11:43:32.950960+0000","last_fullsized":"2020-11-20T11:43:32.950960+0000","mapping_epoch":27,"log_start":"29'17630","ondisk_log_start":"29'17630","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4255623,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2142,"num_read_kb":148296,"num_write":20412,"num_write_kb":686402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727156+0000","last_change":"2020-11-20T11:17:56.596872+0000","last_active":"2020-11-20T11:18:02.727156+0000","last_peered":"2020-11-20T11:18:02.727156+0000","last_clean":"2020-11-20T11:18:02.727156+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:18:02.727156+0000","last_undegraded":"2020-11-20T11:18:02.727156+0000","last_fullsized":"2020-11-20T11:18:02.727156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'21468","reported_seq":"21479","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.247648+0000","last_change":"2020-11-20T11:18:00.078924+0000","last_active":"2020-11-20T11:43:18.247648+0000","last_peered":"2020-11-20T11:43:18.247648+0000","last_clean":"2020-11-20T11:43:18.247648+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:43:18.247648+0000","last_undegraded":"2020-11-20T11:43:18.247648+0000","last_fullsized":"2020-11-20T11:43:18.247648+0000","mapping_epoch":24,"log_start":"29'11400","ondisk_log_start":"29'11400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10068,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943074,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":21508,"num_write_kb":159909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"29'25874","reported_seq":"29285","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:32.925778+0000","last_change":"2020-11-20T11:18:02.983930+0000","last_active":"2020-11-20T11:43:32.925778+0000","last_peered":"2020-11-20T11:43:32.925778+0000","last_clean":"2020-11-20T11:43:32.925778+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:43:32.925778+0000","last_undegraded":"2020-11-20T11:43:32.925778+0000","last_fullsized":"2020-11-20T11:43:32.925778+0000","mapping_epoch":27,"log_start":"29'15775","ondisk_log_start":"29'15775","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10099,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1998376,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3402,"num_read_kb":211712,"num_write":18610,"num_write_kb":503848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730426+0000","last_change":"2020-11-20T11:17:56.650092+0000","last_active":"2020-11-20T11:18:02.730426+0000","last_peered":"2020-11-20T11:18:02.730426+0000","last_clean":"2020-11-20T11:18:02.730426+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:18:02.730426+0000","last_undegraded":"2020-11-20T11:18:02.730426+0000","last_fullsized":"2020-11-20T11:18:02.730426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'18505","reported_seq":"18516","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:22.980318+0000","last_change":"2020-11-20T11:18:00.079058+0000","last_active":"2020-11-20T11:43:22.980318+0000","last_peered":"2020-11-20T11:43:22.980318+0000","last_clean":"2020-11-20T11:43:22.980318+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:43:22.980318+0000","last_undegraded":"2020-11-20T11:43:22.980318+0000","last_fullsized":"2020-11-20T11:43:22.980318+0000","mapping_epoch":24,"log_start":"29'8500","ondisk_log_start":"29'8500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10005,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":18569,"num_write_kb":134049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"29'26641","reported_seq":"28982","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:32.114936+0000","last_change":"2020-11-20T11:18:02.735144+0000","last_active":"2020-11-20T11:43:32.114936+0000","last_peered":"2020-11-20T11:43:32.114936+0000","last_clean":"2020-11-20T11:43:32.114936+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:43:32.114936+0000","last_undegraded":"2020-11-20T11:43:32.114936+0000","last_fullsized":"2020-11-20T11:43:32.114936+0000","mapping_epoch":27,"log_start":"29'16620","ondisk_log_start":"29'16620","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6593671,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":2330,"num_read_kb":130128,"num_write":19275,"num_write_kb":649312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981614+0000","last_change":"2020-11-20T11:17:56.679644+0000","last_active":"2020-11-20T11:18:02.981614+0000","last_peered":"2020-11-20T11:18:02.981614+0000","last_clean":"2020-11-20T11:18:02.981614+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:18:02.981614+0000","last_undegraded":"2020-11-20T11:18:02.981614+0000","last_fullsized":"2020-11-20T11:18:02.981614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'3","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727126+0000","last_change":"2020-11-20T11:17:52.237351+0000","last_active":"2020-11-20T11:18:02.727126+0000","last_peered":"2020-11-20T11:18:02.727126+0000","last_clean":"2020-11-20T11:18:02.727126+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:18:02.727126+0000","last_undegraded":"2020-11-20T11:18:02.727126+0000","last_fullsized":"2020-11-20T11:18:02.727126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_clean_scrub_stamp":"2020-11-20T11:17:46.208466+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'22063","reported_seq":"22075","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:27.105883+0000","last_change":"2020-11-20T11:17:59.712995+0000","last_active":"2020-11-20T11:43:27.105883+0000","last_peered":"2020-11-20T11:43:27.105883+0000","last_clean":"2020-11-20T11:43:27.105883+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:43:27.105883+0000","last_undegraded":"2020-11-20T11:43:27.105883+0000","last_fullsized":"2020-11-20T11:43:27.105883+0000","mapping_epoch":24,"log_start":"29'12000","ondisk_log_start":"29'12000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10063,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25357767,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22085,"num_write_kb":156445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'26996","reported_seq":"30083","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:31.312599+0000","last_change":"2020-11-20T11:18:02.984495+0000","last_active":"2020-11-20T11:43:31.312599+0000","last_peered":"2020-11-20T11:43:31.312599+0000","last_clean":"2020-11-20T11:43:31.312599+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:43:31.312599+0000","last_undegraded":"2020-11-20T11:43:31.312599+0000","last_fullsized":"2020-11-20T11:43:31.312599+0000","mapping_epoch":27,"log_start":"29'16948","ondisk_log_start":"29'16948","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10048,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6331933,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":3076,"num_read_kb":198434,"num_write":19592,"num_write_kb":812748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727158+0000","last_change":"2020-11-20T11:17:56.679955+0000","last_active":"2020-11-20T11:18:02.727158+0000","last_peered":"2020-11-20T11:18:02.727158+0000","last_clean":"2020-11-20T11:18:02.727158+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:18:02.727158+0000","last_undegraded":"2020-11-20T11:18:02.727158+0000","last_fullsized":"2020-11-20T11:18:02.727158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15578","reported_seq":"16562","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.227426+0000","last_change":"2020-11-20T11:18:00.078954+0000","last_active":"2020-11-20T11:43:18.227426+0000","last_peered":"2020-11-20T11:43:18.227426+0000","last_clean":"2020-11-20T11:43:18.227426+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:43:18.227426+0000","last_undegraded":"2020-11-20T11:43:18.227426+0000","last_fullsized":"2020-11-20T11:43:18.227426+0000","mapping_epoch":24,"log_start":"29'5500","ondisk_log_start":"29'5500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10078,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":4817,"num_write":15600,"num_write_kb":119720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'26765","reported_seq":"28201","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:31.343980+0000","last_change":"2020-11-20T11:18:02.735416+0000","last_active":"2020-11-20T11:43:31.343980+0000","last_peered":"2020-11-20T11:43:31.343980+0000","last_clean":"2020-11-20T11:43:31.343980+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:43:31.343980+0000","last_undegraded":"2020-11-20T11:43:31.343980+0000","last_fullsized":"2020-11-20T11:43:31.343980+0000","mapping_epoch":27,"log_start":"29'16715","ondisk_log_start":"29'16715","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10050,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7459644,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":1425,"num_read_kb":95802,"num_write":19325,"num_write_kb":604990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.728849+0000","last_change":"2020-11-20T11:17:56.678488+0000","last_active":"2020-11-20T11:18:02.728849+0000","last_peered":"2020-11-20T11:18:02.728849+0000","last_clean":"2020-11-20T11:18:02.728849+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:18:02.728849+0000","last_undegraded":"2020-11-20T11:18:02.728849+0000","last_fullsized":"2020-11-20T11:18:02.728849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'21553","reported_seq":"22073","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:28.008600+0000","last_change":"2020-11-20T11:18:00.078835+0000","last_active":"2020-11-20T11:43:28.008600+0000","last_peered":"2020-11-20T11:43:28.008600+0000","last_clean":"2020-11-20T11:43:28.008600+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:43:28.008600+0000","last_undegraded":"2020-11-20T11:43:28.008600+0000","last_fullsized":"2020-11-20T11:43:28.008600+0000","mapping_epoch":24,"log_start":"29'11500","ondisk_log_start":"29'11500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10053,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53257703,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":512,"num_read_kb":3197,"num_write":21590,"num_write_kb":163023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"29'27740","reported_seq":"30259","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:31.404757+0000","last_change":"2020-11-20T11:18:02.984543+0000","last_active":"2020-11-20T11:43:31.404757+0000","last_peered":"2020-11-20T11:43:31.404757+0000","last_clean":"2020-11-20T11:43:31.404757+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:43:31.404757+0000","last_undegraded":"2020-11-20T11:43:31.404757+0000","last_fullsized":"2020-11-20T11:43:31.404757+0000","mapping_epoch":27,"log_start":"29'17642","ondisk_log_start":"29'17642","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10098,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7301775,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":2508,"num_read_kb":194578,"num_write":20441,"num_write_kb":678922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'12647","reported_seq":"13378","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.254607+0000","last_change":"2020-11-20T11:18:00.078852+0000","last_active":"2020-11-20T11:43:18.254607+0000","last_peered":"2020-11-20T11:43:18.254607+0000","last_clean":"2020-11-20T11:43:18.254607+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:43:18.254607+0000","last_undegraded":"2020-11-20T11:43:18.254607+0000","last_fullsized":"2020-11-20T11:43:18.254607+0000","mapping_epoch":24,"log_start":"29'2600","ondisk_log_start":"29'2600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20972095,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":722,"num_read_kb":4571,"num_write":12693,"num_write_kb":97715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725499+0000","last_change":"2020-11-20T11:17:56.594357+0000","last_active":"2020-11-20T11:18:02.725499+0000","last_peered":"2020-11-20T11:18:02.725499+0000","last_clean":"2020-11-20T11:18:02.725499+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:18:02.725499+0000","last_undegraded":"2020-11-20T11:18:02.725499+0000","last_fullsized":"2020-11-20T11:18:02.725499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"29'26916","reported_seq":"28253","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:31.090154+0000","last_change":"2020-11-20T11:18:02.984521+0000","last_active":"2020-11-20T11:43:31.090154+0000","last_peered":"2020-11-20T11:43:31.090154+0000","last_clean":"2020-11-20T11:43:31.090154+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:43:31.090154+0000","last_undegraded":"2020-11-20T11:43:31.090154+0000","last_fullsized":"2020-11-20T11:43:31.090154+0000","mapping_epoch":27,"log_start":"29'16857","ondisk_log_start":"29'16857","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10059,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9249386,"num_objects":90,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":1326,"num_read_kb":63596,"num_write":19608,"num_write_kb":703697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981711+0000","last_change":"2020-11-20T11:17:56.681946+0000","last_active":"2020-11-20T11:18:02.981711+0000","last_peered":"2020-11-20T11:18:02.981711+0000","last_clean":"2020-11-20T11:18:02.981711+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:18:02.981711+0000","last_undegraded":"2020-11-20T11:18:02.981711+0000","last_fullsized":"2020-11-20T11:18:02.981711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'19969","reported_seq":"19980","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:22.979213+0000","last_change":"2020-11-20T11:17:59.712094+0000","last_active":"2020-11-20T11:43:22.979213+0000","last_peered":"2020-11-20T11:43:22.979213+0000","last_clean":"2020-11-20T11:43:22.979213+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:43:22.979213+0000","last_undegraded":"2020-11-20T11:43:22.979213+0000","last_fullsized":"2020-11-20T11:43:22.979213+0000","mapping_epoch":24,"log_start":"29'9900","ondisk_log_start":"29'9900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10069,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":20595,"num_write_kb":146710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":49029543,"num_objects":489,"num_object_clones":0,"num_object_copies":1956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489,"num_whiteouts":0,"num_read":17400,"num_read_kb":1120836,"num_write":157671,"num_write_kb":5367938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":116088832,"data_stored":116088832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80536,"ondisk_log_size":80536,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":254777007,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":2223,"num_read_kb":12585,"num_write":156097,"num_write_kb":1143429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":84,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":509616128,"data_stored":509554014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80409,"ondisk_log_size":80409,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411639,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111160,"kb_used_data":6384,"kb_used_omap":0,"kb_used_meta":104768,"kb_avail":94260680,"statfs":{"total":96636764160,"available":96522936320,"internally_reserved":0,"allocated":6537216,"data_stored":6372393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":107282432},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.7669999999999999,"15min":1.264},"min":{"1min":0.62,"5min":0.57399999999999995,"15min":0.48199999999999998},"max":{"1min":4.2160000000000002,"5min":60.896000000000001,"15min":60.896000000000001},"last":1.611},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.8999999999999999,"15min":1.329},"min":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"max":{"1min":1.9990000000000001,"5min":64.224000000000004,"15min":64.224000000000004},"last":0.98599999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.169,"15min":1.131},"min":{"1min":0.63,"5min":0.59299999999999997,"15min":0.56999999999999995},"max":{"1min":3.1240000000000001,"5min":5.4260000000000002,"15min":11.624000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3460000000000001,"15min":1.264},"min":{"1min":0.71699999999999997,"5min":0.59999999999999998,"15min":0.46600000000000003},"max":{"1min":1.9610000000000001,"5min":6.3129999999999997,"15min":6.375},"last":1.097}]},{"osd":2,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.24},"min":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":3.6059999999999999,"5min":9.5730000000000004,"15min":11.711},"last":4.9950000000000001},{"interface":"front","average":{"1min":1.784,"5min":1.605,"15min":1.377},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.6820000000000004,"5min":10.047000000000001,"15min":10.047000000000001},"last":2.6890000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":3.5510000000000002,"5min":2.2730000000000001,"15min":1.786},"min":{"1min":0.82099999999999995,"5min":0.75,"15min":0.61899999999999999},"max":{"1min":41.573999999999998,"5min":41.573999999999998,"15min":41.573999999999998},"last":1.446},{"interface":"front","average":{"1min":3.6930000000000001,"5min":2.125,"15min":1.6639999999999999},"min":{"1min":0.88800000000000001,"5min":0.79100000000000004,"15min":0.60299999999999998},"max":{"1min":46.341999999999999,"5min":46.341999999999999,"15min":46.341999999999999},"last":1.1459999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.534,"15min":1.4430000000000001},"min":{"1min":0.86299999999999999,"5min":0.76600000000000001,"15min":0.626},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.3819999999999997},"last":2.2839999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.7749999999999999,"15min":1.6439999999999999},"min":{"1min":0.93999999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0779999999999998,"5min":9.7059999999999995,"15min":9.7059999999999995},"last":1.2090000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":5.0979999999999999,"5min":2.7400000000000002,"15min":2.0369999999999999},"min":{"1min":1.044,"5min":0.85999999999999999,"15min":0.85699999999999998},"max":{"1min":22.707999999999998,"5min":22.707999999999998,"15min":22.707999999999998},"last":1.425},{"interface":"front","average":{"1min":6.4080000000000004,"5min":2.9460000000000002,"15min":2.0880000000000001},"min":{"1min":0.99299999999999999,"5min":0.96199999999999997,"15min":0.76600000000000001},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":5.4569999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.905,"15min":1.788},"min":{"1min":1.0429999999999999,"5min":0.97399999999999998,"15min":0.88300000000000001},"max":{"1min":2.206,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":3.1949999999999998},{"interface":"front","average":{"1min":1.746,"5min":1.8939999999999999,"15min":1.7669999999999999},"min":{"1min":1.02,"5min":0.96299999999999997,"15min":0.72199999999999998},"max":{"1min":4.6980000000000004,"5min":6.5750000000000002,"15min":12.638999999999999},"last":1.575}]},{"osd":9,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2160000000000002,"5min":1.988,"15min":1.806},"min":{"1min":1.085,"5min":1.0229999999999999,"15min":0.99299999999999999},"max":{"1min":7.1470000000000002,"5min":7.1470000000000002,"15min":9.8529999999999998},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.913,"5min":2.0449999999999999,"15min":1.921},"min":{"1min":1.026,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.7599999999999998,"5min":10.669,"15min":10.669},"last":2.532}]},{"osd":10,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.0609999999999999,"15min":1.857},"min":{"1min":1.1639999999999999,"5min":1.1040000000000001,"15min":1.0680000000000001},"max":{"1min":7.3390000000000004,"5min":7.3390000000000004,"15min":12.757},"last":2.1299999999999999},{"interface":"front","average":{"1min":2.4220000000000002,"5min":1.944,"15min":1.786},"min":{"1min":1.133,"5min":1.105,"15min":0.98099999999999998},"max":{"1min":7.4139999999999997,"5min":7.4139999999999997,"15min":7.8620000000000001},"last":2.5600000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.9670000000000001,"15min":1.873},"min":{"1min":1.109,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.331,"5min":7.8179999999999996,"15min":7.8179999999999996},"last":5.6420000000000003},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.3300000000000001,"15min":1.996},"min":{"1min":1.099,"5min":1.099,"15min":1.079},"max":{"1min":6.9530000000000003,"5min":7.859,"15min":12.827},"last":1.8640000000000001}]}]},{"osd":7,"up_from":18,"seq":77309411639,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":212764,"kb_used_data":16924,"kb_used_omap":0,"kb_used_meta":195712,"kb_avail":94159076,"statfs":{"total":96636764160,"available":96418893824,"internally_reserved":0,"allocated":17330176,"data_stored":17165353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":200409088},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2490000000000001,"15min":1.1579999999999999},"min":{"1min":0.58099999999999996,"5min":0.48999999999999999,"15min":0.45400000000000001},"max":{"1min":4.2850000000000001,"5min":5.6310000000000002,"15min":10.59},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.23,"5min":1.4750000000000001,"15min":1.4039999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.524,"5min":15.769,"15min":27.672999999999998},"last":0.85999999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.3380000000000001,"15min":1.2110000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2349999999999999,"5min":8.5679999999999996,"15min":8.5679999999999996},"last":0.747},{"interface":"front","average":{"1min":1.228,"5min":1.575,"15min":1.476},"min":{"1min":0.77000000000000002,"5min":0.63800000000000001,"15min":0.503},"max":{"1min":2.6869999999999998,"5min":8.6850000000000005,"15min":9.0530000000000008},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.4710000000000001,"15min":1.4770000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.60199999999999998},"max":{"1min":3.0099999999999998,"5min":7.5899999999999999,"15min":28.530000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.238,"5min":1.6359999999999999,"15min":1.4490000000000001},"min":{"1min":0.77300000000000002,"5min":0.65900000000000003,"15min":0.50600000000000001},"max":{"1min":2.109,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":1.1659999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.6990000000000001,"15min":1.5509999999999999},"min":{"1min":0.71999999999999997,"5min":0.65600000000000003,"15min":0.61699999999999999},"max":{"1min":5.5629999999999997,"5min":8.6660000000000004,"15min":8.6660000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.7210000000000001,"15min":1.7569999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68799999999999994},"max":{"1min":3.113,"5min":7.4459999999999997,"15min":27.812000000000001},"last":1.129}]},{"osd":5,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.78,"15min":1.627},"min":{"1min":0.84799999999999998,"5min":0.69299999999999995,"15min":0.67400000000000004},"max":{"1min":3.6930000000000001,"5min":9.0139999999999993,"15min":10.208},"last":1.105},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.8149999999999999,"15min":1.633},"min":{"1min":0.85499999999999998,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":2.165,"5min":12.459,"15min":12.459},"last":1.3100000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.7280000000000002,"15min":2.0049999999999999},"min":{"1min":0.95299999999999996,"5min":0.73199999999999998,"15min":0.69299999999999995},"max":{"1min":12.472,"5min":24.305,"15min":24.305},"last":1.4419999999999999},{"interface":"front","average":{"1min":2.6600000000000001,"5min":2.9700000000000002,"15min":2.2770000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":0.86899999999999999},"max":{"1min":21.210000000000001,"5min":24.324999999999999,"15min":24.324999999999999},"last":1.2230000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.8540000000000001,"15min":1.845},"min":{"1min":1.0369999999999999,"5min":0.93100000000000005,"15min":0.69799999999999995},"max":{"1min":3.2120000000000002,"5min":7.7149999999999999,"15min":28.039999999999999},"last":1.387},{"interface":"front","average":{"1min":1.679,"5min":2.0249999999999999,"15min":1.8120000000000001},"min":{"1min":1.1759999999999999,"5min":0.92800000000000005,"15min":0.83499999999999996},"max":{"1min":2.8460000000000001,"5min":8.0730000000000004,"15min":8.4949999999999992},"last":1.5469999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":2.1840000000000002,"15min":2.2440000000000002},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":8.4589999999999996,"15min":56.667999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.1749999999999998,"15min":2.1829999999999998},"min":{"1min":1.214,"5min":1.018,"15min":0.94999999999999996},"max":{"1min":3.7909999999999999,"5min":9.9740000000000002,"15min":55.774000000000001},"last":1.3640000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.9530000000000001,"15min":1.9159999999999999},"min":{"1min":1.089,"5min":1.034,"15min":0.71499999999999997},"max":{"1min":3.3130000000000002,"5min":7.835,"15min":27.931999999999999},"last":1.468},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0089999999999999,"15min":2.0030000000000001},"min":{"1min":1.2669999999999999,"5min":1.1439999999999999,"15min":0.89000000000000001},"max":{"1min":2.8820000000000001,"5min":7.657,"15min":17.899000000000001},"last":1.6910000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":2.2290000000000001,"15min":1.9930000000000001},"min":{"1min":1.097,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":3.4860000000000002,"5min":8.8070000000000004,"15min":10.467000000000001},"last":1.486},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.2669999999999999,"15min":2.1389999999999998},"min":{"1min":1.2230000000000001,"5min":1.147,"15min":0.99299999999999999},"max":{"1min":5.8220000000000001,"5min":8.2260000000000009,"15min":28.638999999999999},"last":1.534}]}]},{"osd":1,"up_from":18,"seq":77309411638,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104876,"kb_used_data":7460,"kb_used_omap":0,"kb_used_meta":97408,"kb_avail":94266964,"statfs":{"total":96636764160,"available":96529371136,"internally_reserved":0,"allocated":7639040,"data_stored":7474217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":99745792},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1890000000000001,"15min":1.0029999999999999},"min":{"1min":0.60399999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.1379999999999999,"5min":4.7859999999999996,"15min":6.5350000000000001},"last":1.395},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.583,"15min":1.397},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":4.7830000000000004,"5min":4.9539999999999997,"15min":6.649},"last":1.792}]},{"osd":2,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.268,"15min":1.306},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.56299999999999994},"max":{"1min":3.7890000000000001,"5min":6.9470000000000001,"15min":29.122},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.0549999999999999},"min":{"1min":0.65400000000000003,"5min":0.59599999999999997,"15min":0.57899999999999996},"max":{"1min":2.6070000000000002,"5min":2.7229999999999999,"15min":3.9830000000000001},"last":1.53}]},{"osd":3,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.488,"15min":1.6699999999999999},"min":{"1min":0.76300000000000001,"5min":0.61099999999999999,"15min":0.60999999999999999},"max":{"1min":3.944,"5min":5.6719999999999997,"15min":69.046000000000006},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4179999999999999,"15min":1.6759999999999999},"min":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.343,"5min":5.0030000000000001,"15min":69.950000000000003},"last":1.6830000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.4690000000000001,"15min":1.367},"min":{"1min":0.93700000000000006,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.258,"5min":4.4779999999999998,"15min":6.3419999999999996},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.923,"5min":1.6519999999999999,"15min":1.5189999999999999},"min":{"1min":0.85199999999999998,"5min":0.70099999999999996,"15min":0.65200000000000002},"max":{"1min":4.4539999999999997,"5min":7.1079999999999997,"15min":7.1079999999999997},"last":1.004}]},{"osd":5,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5489999999999999,"15min":1.4750000000000001},"min":{"1min":0.88300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8210000000000002,"5min":6.3449999999999998,"15min":9.8879999999999999},"last":2.4100000000000001},{"interface":"front","average":{"1min":1.7509999999999999,"5min":1.659,"15min":1.5449999999999999},"min":{"1min":0.90200000000000002,"5min":0.86899999999999999,"15min":0.84199999999999997},"max":{"1min":4.4720000000000004,"5min":4.5960000000000001,"15min":5.8700000000000001},"last":1.6699999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":3.3580000000000001,"5min":2.7130000000000001,"15min":2.3620000000000001},"min":{"1min":1.0640000000000001,"5min":0.91700000000000004,"15min":0.84799999999999998},"max":{"1min":14.183,"5min":47.176000000000002,"15min":69.305999999999997},"last":1.1200000000000001},{"interface":"front","average":{"1min":3.4039999999999999,"5min":2.2229999999999999,"15min":1.889},"min":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.81299999999999994},"max":{"1min":19.556000000000001,"5min":19.556000000000001,"15min":19.556000000000001},"last":1.8140000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.8460000000000001,"15min":1.72},"min":{"1min":1.266,"5min":0.93700000000000006,"15min":0.92200000000000004},"max":{"1min":4.3689999999999998,"5min":5.46,"15min":7.5789999999999997},"last":2.1880000000000002},{"interface":"front","average":{"1min":2.1200000000000001,"5min":1.843,"15min":1.7969999999999999},"min":{"1min":1.0660000000000001,"5min":0.98299999999999998,"15min":0.92000000000000004},"max":{"1min":4.3310000000000004,"5min":7.1500000000000004,"15min":7.4699999999999998},"last":1.651}]},{"osd":8,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.956,"5min":1.821,"15min":1.724},"min":{"1min":1.0669999999999999,"5min":1.006,"15min":0.88900000000000001},"max":{"1min":5.0140000000000002,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":2.0459999999999998},{"interface":"front","average":{"1min":1.9279999999999999,"5min":1.948,"15min":1.7989999999999999},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":4.5759999999999996,"5min":5.056,"15min":5.452},"last":1.9119999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.657,"15min":2.1629999999999998},"min":{"1min":1.0860000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.8849999999999998,"5min":47.082000000000001,"15min":47.082000000000001},"last":2.0249999999999999},{"interface":"front","average":{"1min":2.1949999999999998,"5min":2.6160000000000001,"15min":2.1200000000000001},"min":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.028},"max":{"1min":4.2030000000000003,"5min":47.012999999999998,"15min":47.012999999999998},"last":1.5029999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":1.9810000000000001,"15min":1.8360000000000001},"min":{"1min":1.23,"5min":1.0740000000000001,"15min":1.0640000000000001},"max":{"1min":3.6680000000000001,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":1.931},{"interface":"front","average":{"1min":2.5590000000000002,"5min":2.7690000000000001,"15min":2.1930000000000001},"min":{"1min":1.3440000000000001,"5min":1.2330000000000001,"15min":1.1459999999999999},"max":{"1min":6.3609999999999998,"5min":47.206000000000003,"15min":47.206000000000003},"last":2.1179999999999999}]}]},{"osd":11,"up_from":18,"seq":77309411639,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261824,"kb_used_data":37304,"kb_used_omap":0,"kb_used_meta":224512,"kb_avail":94110016,"statfs":{"total":96636764160,"available":96368656384,"internally_reserved":0,"allocated":38199296,"data_stored":38026856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229900288},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.268,"15min":1.111},"min":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.6880000000000002,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":2.3809999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3100000000000001,"15min":1.2090000000000001},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.55900000000000005},"max":{"1min":8.9870000000000001,"5min":11.206,"15min":11.206},"last":3.9969999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":4.1840000000000002,"15min":2.036},"min":{"1min":0.67200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9279999999999999,"5min":310.21100000000001,"15min":310.21100000000001},"last":2.1989999999999998},{"interface":"front","average":{"1min":1.3999999999999999,"5min":4.258,"15min":2.2709999999999999},"min":{"1min":0.81899999999999995,"5min":0.625,"15min":0.54700000000000004},"max":{"1min":3.8029999999999999,"5min":310.233,"15min":310.233},"last":2.6429999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.3180000000000001,"15min":1.2330000000000001},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.54400000000000004},"max":{"1min":2.4740000000000002,"5min":6.7220000000000004,"15min":6.7220000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.48,"15min":1.335},"min":{"1min":0.82999999999999996,"5min":0.69399999999999995,"15min":0.69099999999999995},"max":{"1min":2.4500000000000002,"5min":6.3550000000000004,"15min":6.9199999999999999},"last":1.744}]},{"osd":3,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.865,"15min":1.6259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71399999999999997,"15min":0.625},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":15.169},"last":5.3540000000000001},{"interface":"front","average":{"1min":1.899,"5min":1.9830000000000001,"15min":1.8080000000000001},"min":{"1min":1.089,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":8.6950000000000003,"5min":8.6950000000000003,"15min":20.972000000000001},"last":5.3170000000000002}]},{"osd":4,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":4.665,"15min":2.4249999999999998},"min":{"1min":0.83199999999999996,"5min":0.68300000000000005,"15min":0.60199999999999998},"max":{"1min":7.7290000000000001,"5min":310.73899999999998,"15min":310.73899999999998},"last":1.627},{"interface":"front","average":{"1min":2.3050000000000002,"5min":4.6429999999999998,"15min":2.5720000000000001},"min":{"1min":1.1180000000000001,"5min":0.90300000000000002,"15min":0.79800000000000004},"max":{"1min":7.0599999999999996,"5min":309.93700000000001,"15min":309.93700000000001},"last":3.093}]},{"osd":5,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.877,"15min":1.718},"min":{"1min":1.056,"5min":0.85299999999999998,"15min":0.79700000000000004},"max":{"1min":3.3530000000000002,"5min":6.8029999999999999,"15min":7.3010000000000002},"last":1.345},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.0459999999999998,"15min":1.792},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":7.5919999999999996,"5min":7.5919999999999996,"15min":7.7649999999999997},"last":2.0800000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":2.3900000000000001,"15min":1.978},"min":{"1min":1.1719999999999999,"5min":0.90800000000000003,"15min":0.83899999999999997},"max":{"1min":8.9239999999999995,"5min":8.9239999999999995,"15min":11.238},"last":1.8620000000000001},{"interface":"front","average":{"1min":2.738,"5min":2.2650000000000001,"15min":1.9730000000000001},"min":{"1min":0.998,"5min":0.97699999999999998,"15min":0.91800000000000004},"max":{"1min":9.952,"5min":9.952,"15min":11.032},"last":2.4470000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.1240000000000001,"5min":4.859,"15min":2.923},"min":{"1min":1.2509999999999999,"5min":1.0880000000000001,"15min":0.753},"max":{"1min":8.532,"5min":310.26100000000002,"15min":310.26100000000002},"last":4.2000000000000002},{"interface":"front","average":{"1min":2.589,"5min":5.1820000000000004,"15min":3.04},"min":{"1min":1.038,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":8.7989999999999995,"5min":313.202,"15min":313.202},"last":1.9710000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.238,"5min":2.077,"15min":1.9159999999999999},"min":{"1min":1.256,"5min":1,"15min":1},"max":{"1min":8.7349999999999994,"5min":8.8000000000000007,"15min":11.145},"last":2.5110000000000001},{"interface":"front","average":{"1min":1.8049999999999999,"5min":1.994,"15min":1.849},"min":{"1min":1.284,"5min":1.1499999999999999,"15min":0.84599999999999997},"max":{"1min":2.968,"5min":8.4100000000000001,"15min":8.4100000000000001},"last":1.4610000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":4.9000000000000004,"15min":2.8500000000000001},"min":{"1min":1.21,"5min":1.069,"15min":1.069},"max":{"1min":7.5330000000000004,"5min":311.82799999999997,"15min":311.82799999999997},"last":2.5720000000000001},{"interface":"front","average":{"1min":1.8240000000000001,"5min":4.9119999999999999,"15min":2.8290000000000002},"min":{"1min":1.3799999999999999,"5min":1.2210000000000001,"15min":1.0880000000000001},"max":{"1min":3.8250000000000002,"5min":310.40800000000002,"15min":310.40800000000002},"last":1.589}]}]},{"osd":10,"up_from":18,"seq":77309411639,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":540532,"kb_used_data":88956,"kb_used_omap":0,"kb_used_meta":451520,"kb_avail":93831308,"statfs":{"total":96636764160,"available":96083259392,"internally_reserved":0,"allocated":91090944,"data_stored":90914027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":462356480},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.659,"15min":1.298},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":5.3129999999999997,"5min":17.451000000000001,"15min":17.451000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.5880000000000001,"15min":1.389},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":3.5510000000000002,"5min":17.646000000000001,"15min":17.646000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1619999999999999,"15min":1.1220000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.59699999999999998},"max":{"1min":4.194,"5min":14.58,"15min":14.58},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.532,"5min":1.5509999999999999,"15min":1.4199999999999999},"min":{"1min":0.749,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":5.1070000000000002,"5min":16.050999999999998,"15min":16.050999999999998},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.2849999999999999,"15min":1.325},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.407,"5min":5.1550000000000002,"15min":27},"last":1.49},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2869999999999999,"15min":1.3169999999999999},"min":{"1min":0.71099999999999997,"5min":0.66000000000000003,"15min":0.64800000000000002},"max":{"1min":4.391,"5min":4.6459999999999999,"15min":9.8219999999999992},"last":1.6240000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2789999999999999,"5min":1.8300000000000001,"15min":1.5269999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.64500000000000002},"max":{"1min":7.532,"5min":15.452999999999999,"15min":15.452999999999999},"last":3.6579999999999999},{"interface":"front","average":{"1min":2.0859999999999999,"5min":1.7809999999999999,"15min":1.6990000000000001},"min":{"1min":0.88200000000000001,"5min":0.69999999999999996,"15min":0.69799999999999995},"max":{"1min":5.2050000000000001,"5min":5.2789999999999999,"15min":16.129999999999999},"last":1.593}]},{"osd":4,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":1.669,"15min":1.534},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":3.8860000000000001,"5min":6.0940000000000003,"15min":7.3049999999999997},"last":2.081},{"interface":"front","average":{"1min":1.907,"5min":1.6279999999999999,"15min":1.5489999999999999},"min":{"1min":0.93600000000000005,"5min":0.92000000000000004,"15min":0.70799999999999996},"max":{"1min":7.2119999999999997,"5min":7.2119999999999997,"15min":9.3699999999999992},"last":2.048}]},{"osd":5,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":2.0489999999999999,"15min":1.8700000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.745},"max":{"1min":6.5750000000000002,"5min":15.561,"15min":40.746000000000002},"last":1.214},{"interface":"front","average":{"1min":2.1400000000000001,"5min":1.929,"15min":1.8},"min":{"1min":1.0249999999999999,"5min":0.92100000000000004,"15min":0.64900000000000002},"max":{"1min":4.0110000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":2.1909999999999998}]},{"osd":6,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":3.5219999999999998,"5min":2.7570000000000001,"15min":2.133},"min":{"1min":1.1930000000000001,"5min":1.1060000000000001,"15min":0.91800000000000004},"max":{"1min":20.754000000000001,"5min":21.189,"15min":21.189},"last":1.8480000000000001},{"interface":"front","average":{"1min":3.8690000000000002,"5min":2.9900000000000002,"15min":2.246},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":21.001999999999999,"5min":22.416,"15min":22.416},"last":1.335}]},{"osd":7,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2749999999999999,"5min":2.1269999999999998,"15min":1.944},"min":{"1min":1.147,"5min":1.147,"15min":0.97799999999999998},"max":{"1min":4.1319999999999997,"5min":9.4939999999999998,"15min":18.797999999999998},"last":2.2999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.8120000000000001,"15min":1.8140000000000001},"min":{"1min":1.165,"5min":1.105,"15min":1.008},"max":{"1min":4.6319999999999997,"5min":6.7699999999999996,"15min":9.6400000000000006},"last":1.75}]},{"osd":9,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.0129999999999999,"15min":1.944},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.143},"max":{"1min":7.8559999999999999,"5min":9.9090000000000007,"15min":9.9090000000000007},"last":2.52},{"interface":"front","average":{"1min":2.274,"5min":2.169,"15min":2.0470000000000002},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":5.5179999999999998,"5min":15.627000000000001,"15min":15.627000000000001},"last":1.4610000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.6970000000000001,"5min":2.2610000000000001,"15min":2.1040000000000001},"min":{"1min":1.282,"5min":1.1539999999999999,"15min":1.044},"max":{"1min":6.8559999999999999,"5min":6.8970000000000002,"15min":10.279},"last":2.4020000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9259999999999999,"15min":1.9239999999999999},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":5.0510000000000002,"5min":6.2119999999999997,"15min":10.076000000000001},"last":1.9510000000000001}]}]},{"osd":9,"up_from":18,"seq":77309411638,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":159656,"kb_used_data":15712,"kb_used_omap":0,"kb_used_meta":143936,"kb_avail":94212184,"statfs":{"total":96636764160,"available":96473276416,"internally_reserved":0,"allocated":16089088,"data_stored":15924265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":147390464},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.631,"15min":1.488},"min":{"1min":0.64500000000000002,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":4.4630000000000001,"5min":9.2539999999999996,"15min":14.436},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.595,"5min":1.7230000000000001,"15min":1.5},"min":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.56299999999999994},"max":{"1min":6.8979999999999997,"5min":7.2480000000000002,"15min":14.875999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.512,"15min":1.3240000000000001},"min":{"1min":0.629,"5min":0.61299999999999999,"15min":0.58099999999999996},"max":{"1min":4.6420000000000003,"5min":6.8410000000000002,"15min":6.8410000000000002},"last":4.5209999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.649,"15min":1.55},"min":{"1min":0.82399999999999995,"5min":0.66500000000000004,"15min":0.66400000000000003},"max":{"1min":4.6840000000000002,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":2.1099999999999999,"15min":1.919},"min":{"1min":0.999,"5min":0.67600000000000005,"15min":0.52800000000000002},"max":{"1min":6.4580000000000002,"5min":10.744,"15min":67.947000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.0339999999999998,"15min":1.881},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66300000000000003},"max":{"1min":4.0899999999999999,"5min":11.935,"15min":67.694999999999993},"last":4.5940000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":2.0649999999999999,"15min":1.9530000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":2.7330000000000001,"5min":7.4960000000000004,"15min":27.167000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.3069999999999999,"5min":2.4049999999999998,"15min":2.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"max":{"1min":6.7859999999999996,"5min":7.4420000000000002,"15min":50.762},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":2.0299999999999998,"15min":1.8720000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.72599999999999998},"max":{"1min":2.8660000000000001,"5min":7.3529999999999998,"15min":7.3529999999999998},"last":1.294},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.278,"15min":1.9550000000000001},"min":{"1min":1.127,"5min":1.0069999999999999,"15min":0.77500000000000002},"max":{"1min":6.577,"5min":7.0170000000000003,"15min":7.0170000000000003},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":2.1850000000000001,"15min":2.2229999999999999},"min":{"1min":1.143,"5min":1.0680000000000001,"15min":0.97799999999999998},"max":{"1min":2.8170000000000002,"5min":6.8559999999999999,"15min":66.474000000000004},"last":1.5900000000000001},{"interface":"front","average":{"1min":2.476,"5min":2.4649999999999999,"15min":2.3540000000000001},"min":{"1min":1.3240000000000001,"5min":1.071,"15min":0.82799999999999996},"max":{"1min":6.6829999999999998,"5min":7.1849999999999996,"15min":66.432000000000002},"last":1.119}]},{"osd":6,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":3.2509999999999999,"15min":3.282},"min":{"1min":0.96699999999999997,"5min":0.89800000000000002,"15min":0.79000000000000004},"max":{"1min":10.946,"5min":17.698,"15min":177.542},"last":4.8840000000000003},{"interface":"front","average":{"1min":2.8570000000000002,"5min":3.4390000000000001,"15min":3.48},"min":{"1min":1.3080000000000001,"5min":1.2949999999999999,"15min":1.1180000000000001},"max":{"1min":11.071999999999999,"5min":16.709,"15min":178.292},"last":1.5}]},{"osd":8,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":2.4289999999999998,"15min":2.3980000000000001},"min":{"1min":1.034,"5min":1.0309999999999999,"15min":0.88100000000000001},"max":{"1min":6.9370000000000003,"5min":12.064,"15min":66.763999999999996},"last":5.0039999999999996},{"interface":"front","average":{"1min":2.3319999999999999,"5min":2.5219999999999998,"15min":2.5470000000000002},"min":{"1min":1.393,"5min":1.2170000000000001,"15min":1.04},"max":{"1min":7.3819999999999997,"5min":7.9100000000000001,"15min":65.933999999999997},"last":1.365}]},{"osd":10,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.476,"5min":2.528,"15min":2.2229999999999999},"min":{"1min":1.0549999999999999,"5min":0.96799999999999997,"15min":0.94499999999999995},"max":{"1min":8.3249999999999993,"5min":11.321999999999999,"15min":11.321999999999999},"last":5.0759999999999996},{"interface":"front","average":{"1min":2.2360000000000002,"5min":2.577,"15min":2.379},"min":{"1min":1.4910000000000001,"5min":1.153,"15min":0.91100000000000003},"max":{"1min":6.6609999999999996,"5min":7.2210000000000001,"15min":7.2210000000000001},"last":1.4339999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.7029999999999998,"5min":2.7349999999999999,"15min":2.5419999999999998},"min":{"1min":1.196,"5min":1.1659999999999999,"15min":0.95899999999999996},"max":{"1min":7.0039999999999996,"5min":7.782,"15min":66.094999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":2.2799999999999998,"5min":2.5110000000000001,"15min":2.5179999999999998},"min":{"1min":1.173,"5min":1.133,"15min":1.014},"max":{"1min":3.54,"5min":11.57,"15min":66.566000000000003},"last":5.1420000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411638,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367976,"kb_used_data":70496,"kb_used_omap":0,"kb_used_meta":297472,"kb_avail":94003864,"statfs":{"total":96636764160,"available":96259956736,"internally_reserved":0,"allocated":72187904,"data_stored":72012304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304611328},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3109999999999999,"15min":1.163},"min":{"1min":0.65300000000000002,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":5.056,"5min":13.025,"15min":13.025},"last":3.637},{"interface":"front","average":{"1min":1.224,"5min":1.373,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.59499999999999997,"15min":0.56499999999999995},"max":{"1min":4.0609999999999999,"5min":12.997,"15min":12.997},"last":3.9199999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5189999999999999,"15min":1.3029999999999999},"min":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":2.9279999999999999,"5min":13.821999999999999,"15min":13.821999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":5.3719999999999999,"5min":13.683999999999999,"15min":13.683999999999999},"last":3.956}]},{"osd":4,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.75,"15min":1.4370000000000001},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"max":{"1min":4.1269999999999998,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.754,"15min":1.633},"min":{"1min":0.75700000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":5.8490000000000002,"5min":14.146000000000001,"15min":14.146000000000001},"last":3.8149999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.782,"15min":1.5269999999999999},"min":{"1min":0.629,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.4880000000000004,"5min":13.715999999999999,"15min":13.715999999999999},"last":4.4829999999999997},{"interface":"front","average":{"1min":1.663,"5min":1.829,"15min":1.548},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.9140000000000001,"5min":14.430999999999999,"15min":14.430999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6799999999999997,"5min":2.9209999999999998,"15min":2.1269999999999998},"min":{"1min":1.01,"5min":0.85799999999999998,"15min":0.65400000000000003},"max":{"1min":28.844000000000001,"5min":28.844000000000001,"15min":28.844000000000001},"last":4.0410000000000004},{"interface":"front","average":{"1min":4.6680000000000001,"5min":2.7320000000000002,"15min":1.988},"min":{"1min":0.86699999999999999,"5min":0.80800000000000005,"15min":0.70699999999999996},"max":{"1min":29.361000000000001,"5min":29.361000000000001,"15min":29.361000000000001},"last":1.0229999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.891,"15min":1.804},"min":{"1min":0.87,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":5.4409999999999998,"5min":14.004,"15min":14.004},"last":4.1319999999999997},{"interface":"front","average":{"1min":1.734,"5min":2.0379999999999998,"15min":1.794},"min":{"1min":1.171,"5min":1.0069999999999999,"15min":0.96399999999999997},"max":{"1min":4.9470000000000001,"5min":13.478,"15min":13.478},"last":4.2699999999999996}]},{"osd":8,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":2.016,"15min":1.8759999999999999},"min":{"1min":1.127,"5min":0.96099999999999997,"15min":0.94799999999999995},"max":{"1min":5.2969999999999997,"5min":13.861000000000001,"15min":13.861000000000001},"last":3.7189999999999999},{"interface":"front","average":{"1min":1.778,"5min":2.234,"15min":1.97},"min":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":5.1790000000000003,"5min":13.359,"15min":13.359},"last":4.1630000000000003}]},{"osd":9,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":3.6469999999999998,"5min":2.5409999999999999,"15min":2.0870000000000002},"min":{"1min":1.046,"5min":1.046,"15min":1.0429999999999999},"max":{"1min":28.672999999999998,"5min":28.672999999999998,"15min":28.672999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.222,"15min":2.0390000000000001},"min":{"1min":1.091,"5min":1.091,"15min":1.091},"max":{"1min":5.726,"5min":14.271000000000001,"15min":14.271000000000001},"last":4.0629999999999997}]},{"osd":10,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":2.2109999999999999,"15min":1.9039999999999999},"min":{"1min":1.147,"5min":1.1120000000000001,"15min":1.0289999999999999},"max":{"1min":5.0629999999999997,"5min":13.597,"15min":13.597},"last":4.3739999999999997},{"interface":"front","average":{"1min":2.1880000000000002,"5min":2.1739999999999999,"15min":1.9490000000000001},"min":{"1min":1.1180000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":5.5140000000000002,"5min":14.555,"15min":14.555},"last":1.226}]},{"osd":11,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":2.2210000000000001,"5min":2.2930000000000001,"15min":2.1299999999999999},"min":{"1min":1.3160000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":5.5709999999999997,"5min":14.396000000000001,"15min":14.396000000000001},"last":4.5179999999999998},{"interface":"front","average":{"1min":2.2029999999999998,"5min":2.3180000000000001,"15min":1.9970000000000001},"min":{"1min":1.379,"5min":1.2250000000000001,"15min":1.155},"max":{"1min":5.2850000000000001,"5min":13.894,"15min":13.894},"last":4.806}]}]},{"osd":0,"up_from":18,"seq":77309411638,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315228,"kb_used_data":51732,"kb_used_omap":0,"kb_used_meta":263488,"kb_avail":94056612,"statfs":{"total":96636764160,"available":96313970688,"internally_reserved":0,"allocated":52973568,"data_stored":52808745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":269811712},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.5409999999999999,"15min":1.359},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.1800000000000002,"5min":12.207000000000001,"15min":12.207000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":2.032,"5min":1.5760000000000001,"15min":1.369},"min":{"1min":0.69099999999999995,"5min":0.625,"15min":0.57099999999999995},"max":{"1min":6.9859999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":1.772}]},{"osd":2,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.631,"15min":1.4239999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59999999999999998},"max":{"1min":4.827,"5min":19.777999999999999,"15min":19.777999999999999},"last":2.3250000000000002},{"interface":"front","average":{"1min":2.194,"5min":1.8009999999999999,"15min":1.5800000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":8.1519999999999992,"5min":8.1519999999999992,"15min":8.1519999999999992},"last":2.0579999999999998}]},{"osd":3,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":2.6659999999999999,"15min":2.1059999999999999},"min":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.627},"max":{"1min":8.5869999999999997,"5min":21.550999999999998,"15min":28.312000000000001},"last":1.597},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.71,"15min":1.681},"min":{"1min":0.74399999999999999,"5min":0.66700000000000004,"15min":0.57499999999999996},"max":{"1min":2.8769999999999998,"5min":19.666,"15min":19.666},"last":2.46}]},{"osd":4,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.145,"15min":1.8240000000000001},"min":{"1min":0.82099999999999995,"5min":0.79900000000000004,"15min":0.76100000000000001},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":2.218},{"interface":"front","average":{"1min":1.726,"5min":2.4159999999999999,"15min":1.9970000000000001},"min":{"1min":1.1160000000000001,"5min":0.98499999999999999,"15min":0.91100000000000003},"max":{"1min":3.8260000000000001,"5min":19.378,"15min":19.378},"last":1.7210000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":2.597,"15min":2.214},"min":{"1min":1.0660000000000001,"5min":0.99399999999999999,"15min":0.73499999999999999},"max":{"1min":3.766,"5min":19.501000000000001,"15min":19.501000000000001},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.8340000000000001,"5min":2.2530000000000001,"15min":1.9550000000000001},"min":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.83899999999999997},"max":{"1min":5.3170000000000002,"5min":19.905000000000001,"15min":19.905000000000001},"last":2.9039999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":3.109,"5min":2.899,"15min":2.3690000000000002},"min":{"1min":1.22,"5min":0.91300000000000003,"15min":0.75900000000000001},"max":{"1min":10.334,"5min":21.288,"15min":21.288},"last":3.52},{"interface":"front","average":{"1min":3.8780000000000001,"5min":3.7789999999999999,"15min":2.7629999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":0.82199999999999995},"max":{"1min":10.432,"5min":41.530999999999999,"15min":41.530999999999999},"last":3.4470000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":2.7200000000000002,"15min":2.3159999999999998},"min":{"1min":1.325,"5min":1.157,"15min":1.103},"max":{"1min":3.9319999999999999,"5min":21.946000000000002,"15min":21.946000000000002},"last":1.974},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.347,"15min":2.137},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":0.879},"max":{"1min":6.0739999999999998,"5min":21.530000000000001,"15min":21.530000000000001},"last":2.8359999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.9620000000000002,"5min":2.6869999999999998,"15min":2.3239999999999998},"min":{"1min":1.222,"5min":1.018,"15min":1.018},"max":{"1min":11.76,"5min":19.030999999999999,"15min":19.030999999999999},"last":2.363},{"interface":"front","average":{"1min":2.052,"5min":2.847,"15min":2.508},"min":{"1min":1.371,"5min":1.274,"15min":1.2210000000000001},"max":{"1min":4.0350000000000001,"5min":19.600999999999999,"15min":19.600999999999999},"last":2.2599999999999998}]},{"osd":10,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":3.109,"15min":2.5939999999999999},"min":{"1min":1.542,"5min":1.2390000000000001,"15min":1.226},"max":{"1min":4.2400000000000002,"5min":19.678999999999998,"15min":19.678999999999998},"last":2.105},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.5720000000000001,"15min":2.2869999999999999},"min":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":0.995},"max":{"1min":4.04,"5min":21.41,"15min":21.41},"last":2.9900000000000002}]},{"osd":11,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.9359999999999999,"5min":2.8319999999999999,"15min":2.3559999999999999},"min":{"1min":1.3149999999999999,"5min":1.1519999999999999,"15min":1.131},"max":{"1min":8.3979999999999997,"5min":19.155999999999999,"15min":19.155999999999999},"last":2.4900000000000002},{"interface":"front","average":{"1min":2.2000000000000002,"5min":3.0819999999999999,"15min":2.6280000000000001},"min":{"1min":1.3640000000000001,"5min":1.3560000000000001,"15min":1.26},"max":{"1min":4.1369999999999996,"5min":19.818000000000001,"15min":19.818000000000001},"last":2.3879999999999999}]}]},{"osd":3,"up_from":18,"seq":77309411638,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":634448,"kb_used_data":115592,"kb_used_omap":0,"kb_used_meta":518848,"kb_avail":93737392,"statfs":{"total":96636764160,"available":95987089408,"internally_reserved":0,"allocated":118366208,"data_stored":118185167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":531300352},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.6970000000000001,"15min":1.5049999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":8.9789999999999992,"15min":9.4689999999999994},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6879999999999999,"15min":1.4730000000000001},"min":{"1min":0.69599999999999995,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":3.3479999999999999,"5min":4.6260000000000003,"15min":8.6880000000000006},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.6479999999999999,"15min":1.486},"min":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2989999999999999,"5min":8.4220000000000006,"15min":8.4220000000000006},"last":1.327},{"interface":"front","average":{"1min":1.613,"5min":1.7390000000000001,"15min":1.593},"min":{"1min":0.89800000000000002,"5min":0.745,"15min":0.58699999999999997},"max":{"1min":2.6040000000000001,"5min":4.7430000000000003,"15min":6.7709999999999999},"last":1.2629999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.6519999999999999,"15min":1.4830000000000001},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3180000000000001,"5min":6.1879999999999997,"15min":6.1879999999999997},"last":0.88},{"interface":"front","average":{"1min":1.53,"5min":1.9079999999999999,"15min":1.6639999999999999},"min":{"1min":0.94099999999999995,"5min":0.69799999999999995,"15min":0.67200000000000004},"max":{"1min":4.702,"5min":6.9850000000000003,"15min":6.9850000000000003},"last":1.28}]},{"osd":5,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":2.0139999999999998,"15min":1.841},"min":{"1min":1.0009999999999999,"5min":0.81899999999999995,"15min":0.69999999999999996},"max":{"1min":3.238,"5min":7.1509999999999998,"15min":23.041},"last":1.401},{"interface":"front","average":{"1min":1.427,"5min":1.9570000000000001,"15min":1.8380000000000001},"min":{"1min":0.80800000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.407,"5min":6.9619999999999997,"15min":22.581},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.5779999999999998,"5min":2.96,"15min":2.5510000000000002},"min":{"1min":1.04,"5min":0.84699999999999998,"15min":0.69699999999999995},"max":{"1min":18.344999999999999,"5min":23.417000000000002,"15min":67.936999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.7639999999999998,"15min":2.218},"min":{"1min":1.0669999999999999,"5min":0.86099999999999999,"15min":0.82999999999999996},"max":{"1min":17.199000000000002,"5min":19.280999999999999,"15min":19.280999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.879,"5min":2.246,"15min":1.8939999999999999},"min":{"1min":1.3109999999999999,"5min":1.089,"15min":0.84899999999999998},"max":{"1min":3.056,"5min":7.8310000000000004,"15min":7.8310000000000004},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":2.3290000000000002,"15min":2.0499999999999998},"min":{"1min":1.0860000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.7130000000000001,"5min":10.206,"15min":10.206},"last":1.4690000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":2.2109999999999999,"15min":2.0249999999999999},"min":{"1min":1.141,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.0379999999999998,"5min":8.7629999999999999,"15min":10.893000000000001},"last":1.635},{"interface":"front","average":{"1min":2.1160000000000001,"5min":2.2029999999999998,"15min":2.0550000000000002},"min":{"1min":1.4239999999999999,"5min":1.216,"15min":1.02},"max":{"1min":3.4209999999999998,"5min":4.5060000000000002,"15min":10.787000000000001},"last":1.919}]},{"osd":9,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.5499999999999998,"15min":2.3100000000000001},"min":{"1min":1.3540000000000001,"5min":1.157,"15min":1.081},"max":{"1min":3.556,"5min":6.8920000000000003,"15min":9.0779999999999994},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.927,"5min":2.444,"15min":2.2320000000000002},"min":{"1min":1.3109999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.2639999999999998,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.548}]},{"osd":10,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":2.4860000000000002,"15min":2.23},"min":{"1min":1.2470000000000001,"5min":1.1499999999999999,"15min":1.1000000000000001},"max":{"1min":3.149,"5min":8.875,"15min":8.875},"last":1.748},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.3650000000000002,"15min":2.085},"min":{"1min":1.2609999999999999,"5min":1.1899999999999999,"15min":1.0569999999999999},"max":{"1min":4.4770000000000003,"5min":7.7089999999999996,"15min":7.7089999999999996},"last":1.839}]},{"osd":11,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.488,"15min":2.2410000000000001},"min":{"1min":1.4379999999999999,"5min":1.2969999999999999,"15min":1.0860000000000001},"max":{"1min":3.4849999999999999,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":1.7290000000000001},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.4260000000000002,"15min":2.2749999999999999},"min":{"1min":1.4690000000000001,"5min":1.1479999999999999,"15min":1.1459999999999999},"max":{"1min":2.7290000000000001,"5min":6.7889999999999997,"15min":10.993},"last":1.7689999999999999}]}]},{"osd":4,"up_from":18,"seq":77309411639,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":354904,"kb_used_data":79504,"kb_used_omap":0,"kb_used_meta":275392,"kb_avail":94016936,"statfs":{"total":96636764160,"available":96273342464,"internally_reserved":0,"allocated":81412096,"data_stored":81243211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":282001408},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.101,"15min":1.081},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54400000000000004},"max":{"1min":3.3500000000000001,"5min":4.0090000000000003,"15min":4.7480000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7569999999999997,"5min":5.734,"15min":10.750999999999999},"last":4.7569999999999997}]},{"osd":2,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.139,"15min":1.171},"min":{"1min":0.63700000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.5800000000000001,"5min":4.1749999999999998,"15min":5.4240000000000004},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.3009999999999999,"15min":1.3600000000000001},"min":{"1min":0.75,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.518,"5min":5.4379999999999997,"15min":6.8659999999999997},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.5620000000000001,"15min":1.3280000000000001},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.0039999999999996,"5min":28.899999999999999,"15min":28.899999999999999},"last":5.0039999999999996},{"interface":"front","average":{"1min":1.746,"5min":1.9279999999999999,"15min":1.6279999999999999},"min":{"1min":0.80100000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.173,"5min":28.882000000000001,"15min":28.882000000000001},"last":1.0209999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.4470000000000001,"15min":1.343},"min":{"1min":0.65500000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.8439999999999999,"5min":6.1589999999999998,"15min":6.1760000000000002},"last":1.367},{"interface":"front","average":{"1min":1.631,"5min":1.3240000000000001,"15min":1.2949999999999999},"min":{"1min":0.78600000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":6.5129999999999999,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":1.5009999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":2.0030000000000001,"15min":1.6200000000000001},"min":{"1min":0.86899999999999999,"5min":0.73099999999999998,"15min":0.67800000000000005},"max":{"1min":2.621,"5min":18.018000000000001,"15min":18.018000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.5649999999999999,"5min":2.2570000000000001,"15min":1.835},"min":{"1min":0.874,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":4.3140000000000001,"5min":18.004000000000001,"15min":18.004000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5,"15min":1.5309999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.6309999999999998,"5min":6.2300000000000004,"15min":6.7400000000000002},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.782,"5min":1.528,"15min":1.4890000000000001},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":6.2809999999999997,"5min":6.2809999999999997,"15min":7.6699999999999999},"last":1.0900000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.5640000000000001,"15min":1.603},"min":{"1min":0.89100000000000001,"5min":0.79800000000000004,"15min":0.76100000000000001},"max":{"1min":4.319,"5min":4.319,"15min":6.2560000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.7210000000000001,"15min":1.7589999999999999},"min":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.532,"5min":6.3710000000000004,"15min":10.625999999999999},"last":1.1220000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":1.7749999999999999,"15min":1.7589999999999999},"min":{"1min":1.0269999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":6.4480000000000004},"last":5.2400000000000002},{"interface":"front","average":{"1min":1.593,"5min":1.8620000000000001,"15min":1.8779999999999999},"min":{"1min":1.0620000000000001,"5min":0.99399999999999999,"15min":0.90800000000000003},"max":{"1min":2.806,"5min":6.5449999999999999,"15min":6.6310000000000002},"last":1.198}]},{"osd":10,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.6499999999999999,"15min":1.651},"min":{"1min":1.1240000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":1.216},{"interface":"front","average":{"1min":1.9099999999999999,"5min":1.8180000000000001,"15min":1.796},"min":{"1min":1.1539999999999999,"5min":1.0860000000000001,"15min":1.0349999999999999},"max":{"1min":4.8170000000000002,"5min":7.9329999999999998,"15min":7.9329999999999998},"last":1.3}]},{"osd":11,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.8300000000000001,"15min":1.845},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.9279999999999999,"5min":6.4829999999999997,"15min":6.6210000000000004},"last":1.28},{"interface":"front","average":{"1min":1.794,"5min":1.694,"15min":1.675},"min":{"1min":1.1399999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":6.4009999999999998,"5min":6.4009999999999998,"15min":6.4009999999999998},"last":1.7210000000000001}]}]},{"osd":5,"up_from":18,"seq":77309411639,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473992,"kb_used_data":54380,"kb_used_omap":0,"kb_used_meta":419520,"kb_avail":93897848,"statfs":{"total":96636764160,"available":96151396352,"internally_reserved":0,"allocated":55685120,"data_stored":55519728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":429588480},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.268,"15min":1.861},"min":{"1min":0.61899999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.2300000000000004,"5min":12.923,"15min":173.643},"last":1.173},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3520000000000001,"15min":2.0670000000000002},"min":{"1min":0.64800000000000002,"5min":0.63,"15min":0.56299999999999994},"max":{"1min":5.6470000000000002,"5min":10.327999999999999,"15min":173.71899999999999},"last":1.298}]},{"osd":1,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4159999999999999,"15min":1.3},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.51800000000000002},"max":{"1min":3.113,"5min":13.898999999999999,"15min":13.898999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.4990000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59099999999999997},"max":{"1min":4.3680000000000003,"5min":10.234,"15min":10.234},"last":1.264}]},{"osd":2,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.66200000000000003,"5min":0.57899999999999996,"15min":0.54500000000000004},"max":{"1min":5.7720000000000002,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.484,"5min":1.5149999999999999,"15min":1.3580000000000001},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.55800000000000005},"max":{"1min":4.1920000000000002,"5min":10.614000000000001,"15min":10.614000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4690000000000001,"15min":1.454},"min":{"1min":0.95599999999999996,"5min":0.623,"15min":0.623},"max":{"1min":3.3610000000000002,"5min":10.728,"15min":10.728},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.532,"15min":1.544},"min":{"1min":0.83499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.8899999999999997,"5min":10.449999999999999,"15min":10.449999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.1379999999999999,"15min":1.821},"min":{"1min":1.1000000000000001,"5min":0.93300000000000005,"15min":0.70999999999999996},"max":{"1min":7.7080000000000002,"5min":13.782,"15min":13.782},"last":1.53},{"interface":"front","average":{"1min":1.8680000000000001,"5min":2.3730000000000002,"15min":1.9850000000000001},"min":{"1min":0.98699999999999999,"5min":0.89200000000000002,"15min":0.64900000000000002},"max":{"1min":7.633,"5min":20.225999999999999,"15min":20.225999999999999},"last":0.98699999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.8169999999999999,"15min":1.786},"min":{"1min":1.04,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":6.3090000000000002,"5min":10.957000000000001,"15min":11.082000000000001},"last":1.121},{"interface":"front","average":{"1min":1.97,"5min":1.8899999999999999,"15min":1.8520000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.0329999999999999},"max":{"1min":6.0199999999999996,"5min":11.054,"15min":11.054},"last":1.657}]},{"osd":8,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":2.0960000000000001,"15min":1.972},"min":{"1min":1.224,"5min":1.089,"15min":1.0449999999999999},"max":{"1min":5.1589999999999998,"5min":18.199000000000002,"15min":18.199000000000002},"last":1.224},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.895,"15min":1.7350000000000001},"min":{"1min":0.99199999999999999,"5min":0.95699999999999996,"15min":0.76000000000000001},"max":{"1min":5.2149999999999999,"5min":13.041,"15min":13.041},"last":1.347}]},{"osd":9,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.3359999999999999,"15min":1.994},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.86099999999999999},"max":{"1min":11.369,"5min":13.15,"15min":13.15},"last":1.45},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1259999999999999,"15min":2.0030000000000001},"min":{"1min":1.256,"5min":1.1890000000000001,"15min":0.92000000000000004},"max":{"1min":6.6820000000000004,"5min":10.837,"15min":10.837},"last":1.409}]},{"osd":10,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.99,"15min":1.988},"min":{"1min":1.1699999999999999,"5min":1.139,"15min":1.071},"max":{"1min":6.1820000000000004,"5min":16.297999999999998,"15min":16.297999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":2.1200000000000001,"5min":2.016,"15min":2.0129999999999999},"min":{"1min":1.323,"5min":1.2410000000000001,"15min":1.24},"max":{"1min":5.0780000000000003,"5min":10.949999999999999,"15min":10.949999999999999},"last":1.825}]},{"osd":11,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":2.3780000000000001,"15min":2.073},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":0.96599999999999997},"max":{"1min":11.234999999999999,"5min":13.420999999999999,"15min":13.420999999999999},"last":1.573},{"interface":"front","average":{"1min":1.974,"5min":2.516,"15min":2.282},"min":{"1min":1.417,"5min":1.2949999999999999,"15min":1.101},"max":{"1min":4.2599999999999998,"5min":19.321999999999999,"15min":19.321999999999999},"last":1.897}]}]},{"osd":6,"up_from":18,"seq":77309411638,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":498624,"kb_used_data":93240,"kb_used_omap":0,"kb_used_meta":405376,"kb_avail":93873216,"statfs":{"total":96636764160,"available":96126173184,"internally_reserved":0,"allocated":95477760,"data_stored":95302160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":415105024},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.885,"15min":1.591},"min":{"1min":0.68700000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":9.7620000000000005,"5min":12.869999999999999,"15min":12.869999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.982,"5min":2.0550000000000002,"15min":1.6339999999999999},"min":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":8.7110000000000003,"5min":19.547999999999998,"15min":19.547999999999998},"last":2.9980000000000002}]},{"osd":1,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":2.0310000000000001,"15min":1.635},"min":{"1min":0.71299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":27.954999999999998,"5min":27.954999999999998,"15min":27.954999999999998},"last":3.8919999999999999},{"interface":"front","average":{"1min":1.8109999999999999,"5min":2.254,"15min":1.78},"min":{"1min":1.0049999999999999,"5min":0.73499999999999999,"15min":0.57099999999999995},"max":{"1min":9.3130000000000006,"5min":16.134,"15min":16.134},"last":1.9910000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":2.0049999999999999,"15min":1.6479999999999999},"min":{"1min":0.70299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":8.8789999999999996,"5min":15.946,"15min":15.946},"last":2.6859999999999999},{"interface":"front","average":{"1min":3.3559999999999999,"5min":2.2839999999999998,"15min":1.835},"min":{"1min":0.70099999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":28.532,"5min":28.532,"15min":28.532},"last":4.0199999999999996}]},{"osd":3,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.7170000000000001,"5min":2.8199999999999998,"15min":2.4750000000000001},"min":{"1min":0.77800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":19.510999999999999,"5min":19.510999999999999,"15min":96.781999999999996},"last":2.7669999999999999},{"interface":"front","average":{"1min":2.786,"5min":2.6190000000000002,"15min":2.464},"min":{"1min":0.91000000000000003,"5min":0.76400000000000001,"15min":0.69299999999999995},"max":{"1min":16.683,"5min":16.683,"15min":96.558999999999997},"last":3.129}]},{"osd":4,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":3.823,"5min":2.8650000000000002,"15min":2.2400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":28.073,"5min":28.484999999999999,"15min":28.484999999999999},"last":4.3319999999999999},{"interface":"front","average":{"1min":2.379,"5min":2.4870000000000001,"15min":2.0910000000000002},"min":{"1min":1.0169999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":9.6899999999999995,"5min":16.672000000000001,"15min":16.672000000000001},"last":3.6360000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.7360000000000002,"5min":2.9409999999999998,"15min":2.3759999999999999},"min":{"1min":1.016,"5min":0.874,"15min":0.85399999999999998},"max":{"1min":28.414999999999999,"5min":28.622,"15min":28.622},"last":4.4589999999999996},{"interface":"front","average":{"1min":3.1930000000000001,"5min":2.7669999999999999,"15min":2.2450000000000001},"min":{"1min":1.304,"5min":0.88700000000000001,"15min":0.83799999999999997},"max":{"1min":19.669,"5min":19.669,"15min":19.669},"last":2.1200000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.2270000000000003,"5min":3.2189999999999999,"15min":2.4649999999999999},"min":{"1min":1.413,"5min":1.0409999999999999,"15min":0.996},"max":{"1min":30.012,"5min":30.012,"15min":30.012},"last":4.8490000000000002},{"interface":"front","average":{"1min":3.0089999999999999,"5min":2.879,"15min":2.2799999999999998},"min":{"1min":1.1419999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":16.491,"5min":16.712,"15min":16.712},"last":2.23}]},{"osd":8,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.7670000000000003,"5min":3.427,"15min":2.589},"min":{"1min":1.2949999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":28.295999999999999,"5min":28.960000000000001,"15min":28.960000000000001},"last":4.7599999999999998},{"interface":"front","average":{"1min":4.2430000000000003,"5min":3.1259999999999999,"15min":2.4239999999999999},"min":{"1min":1.4350000000000001,"5min":1.04,"15min":1.04},"max":{"1min":19.800000000000001,"5min":19.800000000000001,"15min":19.800000000000001},"last":2.3260000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":2.8279999999999998,"15min":2.2949999999999999},"min":{"1min":1.1279999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":9.8089999999999993,"5min":16.420000000000002,"15min":16.420000000000002},"last":3.7490000000000001},{"interface":"front","average":{"1min":4.8780000000000001,"5min":3.46,"15min":2.7280000000000002},"min":{"1min":1.2070000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":28.178999999999998,"5min":28.882999999999999,"15min":28.882999999999999},"last":4.9429999999999996}]},{"osd":11,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":3.4689999999999999,"15min":2.633},"min":{"1min":1.5589999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":19.920999999999999,"5min":19.920999999999999,"15min":19.920999999999999},"last":2.4220000000000002},{"interface":"front","average":{"1min":3.548,"5min":2.9630000000000001,"15min":2.4129999999999998},"min":{"1min":1.266,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":16.553000000000001,"5min":16.553000000000001,"15min":16.553000000000001},"last":3.8580000000000001}]}]}]}} 2020-11-20T11:43:35.043 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:43:35.151 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.148+0000 7fb1ab34f700 1 Processor -- start 2020-11-20T11:43:35.151 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.148+0000 7fb1ab34f700 1 -- start start 2020-11-20T11:43:35.153 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1ab34f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fb1a40bdc70 0x7fb1a40be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:35.153 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1ab34f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40c3180 con 0x7fb1a40646b0 2020-11-20T11:43:35.153 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1ab34f700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a414f5c0 con 0x7fb1a40c21b0 2020-11-20T11:43:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1ab34f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a4065240 con 0x7fb1a40bdc70 2020-11-20T11:43:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a88ea700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb1a40646b0 0x7fb1a4064b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35550/0 (socket says 172.21.15.112:35550) 2020-11-20T11:43:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a88ea700 1 -- 172.21.15.112:0/832402380 learned_addr learned my addr 172.21.15.112:0/832402380 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a90eb700 1 --2- 172.21.15.112:0/832402380 >> v2:172.21.15.166:3300/0 conn(0x7fb1a40bdc70 0x7fb1a40be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:35.154 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a90eb700 1 -- 172.21.15.112:0/832402380 >> v1:172.21.15.204:6789/0 conn(0x7fb1a40c21b0 legacy=0x7fb1a40c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a90eb700 1 -- 172.21.15.112:0/832402380 >> v1:172.21.15.112:6789/0 conn(0x7fb1a40646b0 legacy=0x7fb1a4064b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a90eb700 1 -- 172.21.15.112:0/832402380 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a414f860 con 0x7fb1a40bdc70 2020-11-20T11:43:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.149+0000 7fb1a90eb700 1 --2- 172.21.15.112:0/832402380 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40be050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb194006fd0 tx=0x7fb194006e30).ready entity=mon.1 client_cookie=f2a69334617e35b6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb193fff700 1 -- 172.21.15.112:0/832402380 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940097e0 con 0x7fb1a40bdc70 2020-11-20T11:43:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb193fff700 1 -- 172.21.15.112:0/832402380 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194000e90 con 0x7fb1a40bdc70 2020-11-20T11:43:35.156 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb193fff700 1 -- 172.21.15.112:0/832402380 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194009b50 con 0x7fb1a40bdc70 2020-11-20T11:43:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 -- 172.21.15.112:0/832402380 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 msgr2=0x7fb1a40be050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/832402380 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40be050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb194006fd0 tx=0x7fb194006e30).stop 2020-11-20T11:43:35.158 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 -- 172.21.15.112:0/832402380 shutdown_connections 2020-11-20T11:43:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/832402380 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40be050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 -- 172.21.15.112:0/832402380 >> 172.21.15.112:0/832402380 conn(0x7fb1a40bbc50 msgr2=0x7fb1a40bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 -- 172.21.15.112:0/832402380 shutdown_connections 2020-11-20T11:43:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.150+0000 7fb1ab34f700 1 -- 172.21.15.112:0/832402380 wait complete. 2020-11-20T11:43:35.159 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.151+0000 7fb1ab34f700 1 Processor -- start 2020-11-20T11:43:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.151+0000 7fb1ab34f700 1 -- start start 2020-11-20T11:43:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:35.160 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a40c21b0 0x7fb1a4149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a415e600 con 0x7fb1a40646b0 2020-11-20T11:43:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4164030 con 0x7fb1a40bdc70 2020-11-20T11:43:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1ab34f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a41642d0 con 0x7fb1a40c21b0 2020-11-20T11:43:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:35.161 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51362/0 (socket says 172.21.15.112:51362) 2020-11-20T11:43:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 -- 172.21.15.112:0/52832058 learned_addr learned my addr 172.21.15.112:0/52832058 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a88ea700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a98ec700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a40c21b0 0x7fb1a4149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 -- 172.21.15.112:0/52832058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a40c21b0 msgr2=0x7fb1a4149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.162 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a40c21b0 0x7fb1a4149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 -- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 msgr2=0x7fb1a40c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 -- 172.21.15.112:0/52832058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4164570 con 0x7fb1a40646b0 2020-11-20T11:43:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a88ea700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:35.163 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.152+0000 7fb1a90eb700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb19400bf40 tx=0x7fb194015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.173+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19401e460 con 0x7fb1a40646b0 2020-11-20T11:43:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.173+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19401e5c0 con 0x7fb1a40646b0 2020-11-20T11:43:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.173+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a4164810 con 0x7fb1a40646b0 2020-11-20T11:43:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.173+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19401e940 con 0x7fb1a40646b0 2020-11-20T11:43:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.173+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a4164d50 con 0x7fb1a40646b0 2020-11-20T11:43:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.174+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a4064490 con 0x7fb1a40646b0 2020-11-20T11:43:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.175+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb194025030 con 0x7fb1a40646b0 2020-11-20T11:43:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.175+0000 7fb1917fa700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 0x7fb17c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.175+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb1940a4340 con 0x7fb1a40646b0 2020-11-20T11:43:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.176+0000 7fb1a88ea700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 0x7fb17c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:35.180 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.176+0000 7fb1a88ea700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 0x7fb17c082b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb1a40bfb10 tx=0x7fb1a0009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:35.182 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.179+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb194078d50 con 0x7fb1a40646b0 2020-11-20T11:43:35.322 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.318+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a40666c0 con 0x7fb1a40646b0 2020-11-20T11:43:35.325 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.319+0000 7fb1917fa700 1 -- 172.21.15.112:0/52832058 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21843 (secure 0 0 0) 0x7fb194023020 con 0x7fb1a40646b0 2020-11-20T11:43:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 msgr2=0x7fb17c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 0x7fb17c082b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb1a40bfb10 tx=0x7fb1a0009040).stop 2020-11-20T11:43:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 msgr2=0x7fb1a4061da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:35.327 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb19400bf40 tx=0x7fb194015000).stop 2020-11-20T11:43:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 shutdown_connections 2020-11-20T11:43:35.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb17c0806a0 0x7fb17c082b60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a40c21b0 0x7fb1a4149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1a40646b0 0x7fb1a4061da0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 --2- 172.21.15.112:0/52832058 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb1a40bdc70 0x7fb1a40c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 >> 172.21.15.112:0/52832058 conn(0x7fb1a40bbc50 msgr2=0x7fb1a40be570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:35.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 shutdown_connections 2020-11-20T11:43:35.331 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:35.321+0000 7fb1ab34f700 1 -- 172.21.15.112:0/52832058 wait complete. 2020-11-20T11:43:35.332 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:43:35.332 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"3ec2328c-34d0-493f-8c83-5fdcfe44cc78","created":"2020-11-20T11:17:42.796670+0000","modified":"2020-11-20T11:18:03.056820+0000","last_up_change":"2020-11-20T11:17:50.553131+0000","last_in_change":"2020-11-20T11:17:50.553131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:17:46.086314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:17:55.502772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:17:58.012089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:18:00.733600+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54aafbc8-d5e6-489d-a1da-e00066837aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":23140},{"type":"v1","addr":"172.21.15.112:6801","nonce":23140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":23140},{"type":"v1","addr":"172.21.15.112:6803","nonce":23140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":23140},{"type":"v1","addr":"172.21.15.112:6807","nonce":23140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":23140},{"type":"v1","addr":"172.21.15.112:6805","nonce":23140}]},"public_addr":"172.21.15.112:6801/23140","cluster_addr":"172.21.15.112:6803/23140","heartbeat_back_addr":"172.21.15.112:6807/23140","heartbeat_front_addr":"172.21.15.112:6805/23140","state":["exists","up"]},{"osd":1,"uuid":"708a3e7b-2c3b-45db-8333-c571a5fe3e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":22858},{"type":"v1","addr":"172.21.15.166:6803","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":22858},{"type":"v1","addr":"172.21.15.166:6805","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":22858},{"type":"v1","addr":"172.21.15.166:6809","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":22858},{"type":"v1","addr":"172.21.15.166:6807","nonce":22858}]},"public_addr":"172.21.15.166:6803/22858","cluster_addr":"172.21.15.166:6805/22858","heartbeat_back_addr":"172.21.15.166:6809/22858","heartbeat_front_addr":"172.21.15.166:6807/22858","state":["exists","up"]},{"osd":2,"uuid":"9cf21648-85a5-4d42-9c73-00bebbb2b440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":23308},{"type":"v1","addr":"172.21.15.204:6801","nonce":23308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":23308},{"type":"v1","addr":"172.21.15.204:6803","nonce":23308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":23308},{"type":"v1","addr":"172.21.15.204:6807","nonce":23308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":23308},{"type":"v1","addr":"172.21.15.204:6805","nonce":23308}]},"public_addr":"172.21.15.204:6801/23308","cluster_addr":"172.21.15.204:6803/23308","heartbeat_back_addr":"172.21.15.204:6807/23308","heartbeat_front_addr":"172.21.15.204:6805/23308","state":["exists","up"]},{"osd":3,"uuid":"91f91662-644d-4bab-b8a0-2149ada31978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":23141},{"type":"v1","addr":"172.21.15.112:6809","nonce":23141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":23141},{"type":"v1","addr":"172.21.15.112:6811","nonce":23141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":23141},{"type":"v1","addr":"172.21.15.112:6815","nonce":23141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":23141},{"type":"v1","addr":"172.21.15.112:6813","nonce":23141}]},"public_addr":"172.21.15.112:6809/23141","cluster_addr":"172.21.15.112:6811/23141","heartbeat_back_addr":"172.21.15.112:6815/23141","heartbeat_front_addr":"172.21.15.112:6813/23141","state":["exists","up"]},{"osd":4,"uuid":"634396c9-f3cd-4f09-8820-277d72bb90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":22859},{"type":"v1","addr":"172.21.15.166:6823","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":22859},{"type":"v1","addr":"172.21.15.166:6827","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":22859},{"type":"v1","addr":"172.21.15.166:6833","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6829","nonce":22859},{"type":"v1","addr":"172.21.15.166:6831","nonce":22859}]},"public_addr":"172.21.15.166:6823/22859","cluster_addr":"172.21.15.166:6827/22859","heartbeat_back_addr":"172.21.15.166:6833/22859","heartbeat_front_addr":"172.21.15.166:6831/22859","state":["exists","up"]},{"osd":5,"uuid":"c52308a3-3724-47de-bb3b-6a773ac734d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":23309},{"type":"v1","addr":"172.21.15.204:6809","nonce":23309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":23309},{"type":"v1","addr":"172.21.15.204:6811","nonce":23309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":23309},{"type":"v1","addr":"172.21.15.204:6815","nonce":23309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":23309},{"type":"v1","addr":"172.21.15.204:6813","nonce":23309}]},"public_addr":"172.21.15.204:6809/23309","cluster_addr":"172.21.15.204:6811/23309","heartbeat_back_addr":"172.21.15.204:6815/23309","heartbeat_front_addr":"172.21.15.204:6813/23309","state":["exists","up"]},{"osd":6,"uuid":"c101d1b8-188b-4a96-a6c8-327b3d6e4b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":23142},{"type":"v1","addr":"172.21.15.112:6817","nonce":23142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":23142},{"type":"v1","addr":"172.21.15.112:6822","nonce":23142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":23142},{"type":"v1","addr":"172.21.15.112:6830","nonce":23142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":23142},{"type":"v1","addr":"172.21.15.112:6826","nonce":23142}]},"public_addr":"172.21.15.112:6817/23142","cluster_addr":"172.21.15.112:6822/23142","heartbeat_back_addr":"172.21.15.112:6830/23142","heartbeat_front_addr":"172.21.15.112:6826/23142","state":["exists","up"]},{"osd":7,"uuid":"6cd744f2-abad-41dd-861f-9c3013306694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":22860},{"type":"v1","addr":"172.21.15.166:6811","nonce":22860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":22860},{"type":"v1","addr":"172.21.15.166:6813","nonce":22860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":22860},{"type":"v1","addr":"172.21.15.166:6817","nonce":22860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":22860},{"type":"v1","addr":"172.21.15.166:6815","nonce":22860}]},"public_addr":"172.21.15.166:6811/22860","cluster_addr":"172.21.15.166:6813/22860","heartbeat_back_addr":"172.21.15.166:6817/22860","heartbeat_front_addr":"172.21.15.166:6815/22860","state":["exists","up"]},{"osd":8,"uuid":"19fa2d8f-a158-46f9-a390-7ffef109f626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":23310},{"type":"v1","addr":"172.21.15.204:6820","nonce":23310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":23310},{"type":"v1","addr":"172.21.15.204:6824","nonce":23310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":23310},{"type":"v1","addr":"172.21.15.204:6831","nonce":23310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":23310},{"type":"v1","addr":"172.21.15.204:6828","nonce":23310}]},"public_addr":"172.21.15.204:6820/23310","cluster_addr":"172.21.15.204:6824/23310","heartbeat_back_addr":"172.21.15.204:6831/23310","heartbeat_front_addr":"172.21.15.204:6828/23310","state":["exists","up"]},{"osd":9,"uuid":"3edbfb9c-833c-4d50-9268-fc07ce6430be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":23143},{"type":"v1","addr":"172.21.15.112:6819","nonce":23143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":23143},{"type":"v1","addr":"172.21.15.112:6823","nonce":23143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6829","nonce":23143},{"type":"v1","addr":"172.21.15.112:6831","nonce":23143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":23143},{"type":"v1","addr":"172.21.15.112:6827","nonce":23143}]},"public_addr":"172.21.15.112:6819/23143","cluster_addr":"172.21.15.112:6823/23143","heartbeat_back_addr":"172.21.15.112:6831/23143","heartbeat_front_addr":"172.21.15.112:6827/23143","state":["exists","up"]},{"osd":10,"uuid":"01bcb4f2-04a5-4e09-9a98-c108f0cea3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":22861},{"type":"v1","addr":"172.21.15.166:6819","nonce":22861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":22861},{"type":"v1","addr":"172.21.15.166:6822","nonce":22861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":22861},{"type":"v1","addr":"172.21.15.166:6830","nonce":22861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":22861},{"type":"v1","addr":"172.21.15.166:6826","nonce":22861}]},"public_addr":"172.21.15.166:6819/22861","cluster_addr":"172.21.15.166:6822/22861","heartbeat_back_addr":"172.21.15.166:6830/22861","heartbeat_front_addr":"172.21.15.166:6826/22861","state":["exists","up"]},{"osd":11,"uuid":"a14fc070-26a3-45cd-9e46-c3dee9296758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":23311},{"type":"v1","addr":"172.21.15.204:6817","nonce":23311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":23311},{"type":"v1","addr":"172.21.15.204:6821","nonce":23311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":23311},{"type":"v1","addr":"172.21.15.204:6829","nonce":23311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":23311},{"type":"v1","addr":"172.21.15.204:6825","nonce":23311}]},"public_addr":"172.21.15.204:6817/23311","cluster_addr":"172.21.15.204:6821/23311","heartbeat_back_addr":"172.21.15.204:6829/23311","heartbeat_front_addr":"172.21.15.204:6825/23311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:48.929145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.168630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.148453+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.143250+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.167029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.229224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.173439+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.205485+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.200608+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.199285+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:17:49.190812+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:43:36.338 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T11:43:36.339 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:36.467 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.463+0000 7f4a0b7a4700 1 Processor -- start 2020-11-20T11:43:36.467 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.463+0000 7f4a0b7a4700 1 -- start start 2020-11-20T11:43:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a0b7a4700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 0x7f4a040bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a0b7a4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a04154c00 0x7f4a04156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a0b7a4700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a040c11d0 con 0x7f4a040616f0 2020-11-20T11:43:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a0b7a4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040c1470 con 0x7f4a04154c00 2020-11-20T11:43:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a0b7a4700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040c1710 con 0x7f4a04061ad0 2020-11-20T11:43:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a04154c00 0x7f4a04156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a04154c00 0x7f4a04156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51374/0 (socket says 172.21.15.112:51374) 2020-11-20T11:43:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 -- 172.21.15.112:0/3318638503 learned_addr learned my addr 172.21.15.112:0/3318638503 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a08d3f700 1 --2- 172.21.15.112:0/3318638503 >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 0x7f4a040bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 -- 172.21.15.112:0/3318638503 >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 msgr2=0x7f4a040bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 --2- 172.21.15.112:0/3318638503 >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 0x7f4a040bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 -- 172.21.15.112:0/3318638503 >> v1:172.21.15.204:6789/0 conn(0x7f4a040616f0 legacy=0x7f4a040bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 -- 172.21.15.112:0/3318638503 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040c19b0 con 0x7f4a04154c00 2020-11-20T11:43:36.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a08d3f700 1 --2- 172.21.15.112:0/3318638503 >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 0x7f4a040bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:36.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.464+0000 7f4a09d41700 1 --2- 172.21.15.112:0/3318638503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04154c00 0x7f4a04156ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f49fc009d90 tx=0x7f49fc0092d0).ready entity=mon.0 client_cookie=f526a1f2220d738d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f49f7fff700 1 -- 172.21.15.112:0/3318638503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00bb70 con 0x7f4a04154c00 2020-11-20T11:43:36.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f49f7fff700 1 -- 172.21.15.112:0/3318638503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00bcd0 con 0x7f4a04154c00 2020-11-20T11:43:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f49f7fff700 1 -- 172.21.15.112:0/3318638503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011610 con 0x7f4a04154c00 2020-11-20T11:43:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/3318638503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04154c00 msgr2=0x7f4a04156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/3318638503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04154c00 0x7f4a04156ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f49fc009d90 tx=0x7f49fc0092d0).stop 2020-11-20T11:43:36.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/3318638503 shutdown_connections 2020-11-20T11:43:36.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/3318638503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04154c00 0x7f4a04156ff0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/3318638503 >> v2:172.21.15.204:3300/0 conn(0x7f4a04061ad0 0x7f4a040bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/3318638503 >> 172.21.15.112:0/3318638503 conn(0x7f4a040bac60 msgr2=0x7f4a040bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/3318638503 shutdown_connections 2020-11-20T11:43:36.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.465+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/3318638503 wait complete. 2020-11-20T11:43:36.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.466+0000 7f4a0b7a4700 1 Processor -- start 2020-11-20T11:43:36.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.466+0000 7f4a0b7a4700 1 -- start start 2020-11-20T11:43:36.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a040616f0 0x7f4a040c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 0x7f4a041621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4a04154c00 0x7f4a0415e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a04161860 con 0x7f4a04061ad0 2020-11-20T11:43:36.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0415eb40 con 0x7f4a04154c00 2020-11-20T11:43:36.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a0b7a4700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0415ede0 con 0x7f4a040616f0 2020-11-20T11:43:36.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 0x7f4a041621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 0x7f4a041621d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51378/0 (socket says 172.21.15.112:51378) 2020-11-20T11:43:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 -- 172.21.15.112:0/2712948661 learned_addr learned my addr 172.21.15.112:0/2712948661 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a09540700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a040616f0 0x7f4a040c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 -- 172.21.15.112:0/2712948661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a040616f0 msgr2=0x7f4a040c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a040616f0 0x7f4a040c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a08d3f700 1 -- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4a04154c00 msgr2=0x7f4a0415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.467+0000 7f4a09d41700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4a04154c00 0x7f4a0415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f4a08d3f700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4a04154c00 0x7f4a0415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f4a08d3f700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0415f080 con 0x7f4a04061ad0 2020-11-20T11:43:36.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f4a08d3f700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 0x7f4a041621d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4a0000cb50 tx=0x7f4a00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000077d0 con 0x7f4a04061ad0 2020-11-20T11:43:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00007930 con 0x7f4a04061ad0 2020-11-20T11:43:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a04161a90 con 0x7f4a04061ad0 2020-11-20T11:43:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007cb0 con 0x7f4a04061ad0 2020-11-20T11:43:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.468+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040c44e0 con 0x7f4a04061ad0 2020-11-20T11:43:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.469+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a040666e0 con 0x7f4a04061ad0 2020-11-20T11:43:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.469+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4a00011620 con 0x7f4a04061ad0 2020-11-20T11:43:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f49f57fa700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f49e0080670 0x7f49e0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4a000a3710 con 0x7f4a04061ad0 2020-11-20T11:43:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f49f57fa700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7f49e00893a0 0x7f49e008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.494 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49e008be20 con 0x7f49e00893a0 2020-11-20T11:43:36.494 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a000a3a80 con 0x7f4a04061ad0 2020-11-20T11:43:36.494 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f4a09540700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f49e0080670 0x7f49e0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.495 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.470+0000 7f4a09d41700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7f49e00893a0 0x7f49e008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.495 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.471+0000 7f4a09540700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f49e0080670 0x7f49e0082b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f49f8003750 tx=0x7f49f8007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.471+0000 7f4a09d41700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7f49e00893a0 0x7f49e008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.471+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== osd.0 v2:172.21.15.112:6800/23140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f49e008be20 con 0x7f49e00893a0 2020-11-20T11:43:36.501 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.484+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 --> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a0415f210 con 0x7f49e00893a0 2020-11-20T11:43:36.501 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.484+0000 7f49f57fa700 1 -- 172.21.15.112:0/2712948661 <== osd.0 v2:172.21.15.112:6800/23140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f49fc006ce0 con 0x7f49e00893a0 2020-11-20T11:43:36.502 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7f49e00893a0 msgr2=0x7f49e008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.502 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:6800/23140,v1:172.21.15.112:6801/23140] conn(0x7f49e00893a0 0x7f49e008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.502 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f49e0080670 msgr2=0x7f49e0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.503 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f49e0080670 0x7f49e0082b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f49f8003750 tx=0x7f49f8007bb0).stop 2020-11-20T11:43:36.503 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 msgr2=0x7f4a041621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 --2- 172.21.15.112:0/2712948661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04061ad0 0x7f4a041621d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4a0000cb50 tx=0x7f4a00008040).stop 2020-11-20T11:43:36.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a09d41700 1 -- 172.21.15.112:0/2712948661 reap_dead start 2020-11-20T11:43:36.504 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 shutdown_connections 2020-11-20T11:43:36.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 >> 172.21.15.112:0/2712948661 conn(0x7f4a040bac60 msgr2=0x7f4a041427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 shutdown_connections 2020-11-20T11:43:36.505 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.485+0000 7f4a0b7a4700 1 -- 172.21.15.112:0/2712948661 wait complete. 2020-11-20T11:43:36.506 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:36.506 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:36.507 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T11:43:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 Processor -- start 2020-11-20T11:43:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 -- start start 2020-11-20T11:43:36.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 0x7f06cc066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f06cc1512e0 0x7f06cc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc0c5230 con 0x7f06cc0bfa50 2020-11-20T11:43:36.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc1549c0 con 0x7f06cc065d30 2020-11-20T11:43:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.613+0000 7f06d2ef6700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc154c60 con 0x7f06cc1512e0 2020-11-20T11:43:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06cbfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f06cc0bfa50 0x7f06cc0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35580/0 (socket says 172.21.15.112:35580) 2020-11-20T11:43:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06cbfff700 1 -- 172.21.15.112:0/41442621 learned_addr learned my addr 172.21.15.112:0/41442621 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d0c92700 1 --2- 172.21.15.112:0/41442621 >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 0x7f06cc066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 --2- 172.21.15.112:0/41442621 >> v2:172.21.15.204:3300/0 conn(0x7f06cc1512e0 0x7f06cc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166346361 0 0) 0x7f06cc0c5230 con 0x7f06cc0bfa50 2020-11-20T11:43:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06b0003280 con 0x7f06cc0bfa50 2020-11-20T11:43:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2285208963 0 0) 0x7f06b0003280 con 0x7f06cc0bfa50 2020-11-20T11:43:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 -- 172.21.15.112:0/41442621 >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 msgr2=0x7f06cc066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 --2- 172.21.15.112:0/41442621 >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 0x7f06cc066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 -- 172.21.15.112:0/41442621 >> v1:172.21.15.112:6789/0 conn(0x7f06cc0bfa50 legacy=0x7f06cc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 -- 172.21.15.112:0/41442621 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc154f00 con 0x7f06cc1512e0 2020-11-20T11:43:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d0c92700 1 --2- 172.21.15.112:0/41442621 >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 0x7f06cc066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.614+0000 7f06d1493700 1 --2- 172.21.15.112:0/41442621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc1512e0 0x7f06cc151710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f06cc0651b0 tx=0x7f06c4009220).ready entity=mon.2 client_cookie=68a678f7700751a2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0001520 con 0x7f06cc1512e0 2020-11-20T11:43:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400b680 con 0x7f06cc1512e0 2020-11-20T11:43:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06cb7fe700 1 -- 172.21.15.112:0/41442621 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400ba00 con 0x7f06cc1512e0 2020-11-20T11:43:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 -- 172.21.15.112:0/41442621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc1512e0 msgr2=0x7f06cc151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/41442621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc1512e0 0x7f06cc151710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f06cc0651b0 tx=0x7f06c4009220).stop 2020-11-20T11:43:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 -- 172.21.15.112:0/41442621 shutdown_connections 2020-11-20T11:43:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/41442621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc1512e0 0x7f06cc151710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/41442621 >> v2:172.21.15.166:3300/0 conn(0x7f06cc065d30 0x7f06cc066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 -- 172.21.15.112:0/41442621 >> 172.21.15.112:0/41442621 conn(0x7f06cc05bac0 msgr2=0x7f06cc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 -- 172.21.15.112:0/41442621 shutdown_connections 2020-11-20T11:43:36.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.615+0000 7f06d2ef6700 1 -- 172.21.15.112:0/41442621 wait complete. 2020-11-20T11:43:36.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.616+0000 7f06d2ef6700 1 Processor -- start 2020-11-20T11:43:36.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.616+0000 7f06d2ef6700 1 -- start start 2020-11-20T11:43:36.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc065d30 0x7f06cc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06cc0bfa50 0x7f06cc1643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1648c0 con 0x7f06cc1512e0 2020-11-20T11:43:36.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0b44b0 con 0x7f06cc0bfa50 2020-11-20T11:43:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d2ef6700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc160640 con 0x7f06cc065d30 2020-11-20T11:43:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51396/0 (socket says 172.21.15.112:51396) 2020-11-20T11:43:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 -- 172.21.15.112:0/414171763 learned_addr learned my addr 172.21.15.112:0/414171763 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06cbfff700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06cc0bfa50 0x7f06cc1643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d0c92700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc065d30 0x7f06cc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 -- 172.21.15.112:0/414171763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc065d30 msgr2=0x7f06cc0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc065d30 0x7f06cc0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 -- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06cc0bfa50 msgr2=0x7f06cc1643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06cc0bfa50 0x7f06cc1643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 -- 172.21.15.112:0/414171763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc1608e0 con 0x7f06cc1512e0 2020-11-20T11:43:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.617+0000 7f06d1493700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f06c40090b0 tx=0x7f06c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.618+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c401c5f0 con 0x7f06cc1512e0 2020-11-20T11:43:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.618+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c401c750 con 0x7f06cc1512e0 2020-11-20T11:43:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.618+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c401cad0 con 0x7f06cc1512e0 2020-11-20T11:43:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.618+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc160b80 con 0x7f06cc1512e0 2020-11-20T11:43:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.618+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1612c0 con 0x7f06cc1512e0 2020-11-20T11:43:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.619+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc160fe0 con 0x7f06cc1512e0 2020-11-20T11:43:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.619+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f06c4017070 con 0x7f06cc1512e0 2020-11-20T11:43:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.620+0000 7f06c8ff9700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 0x7f06a4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.620+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f06c40a57d0 con 0x7f06cc1512e0 2020-11-20T11:43:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.620+0000 7f06d0c92700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 0x7f06a4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.620+0000 7f06d0c92700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 0x7f06a4082b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06b8006c10 tx=0x7f06b8008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.633 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.623+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f06c407a1e0 con 0x7f06cc1512e0 2020-11-20T11:43:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.761+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f06cc065740 con 0x7f06a4080670 2020-11-20T11:43:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.761+0000 7f06c8ff9700 1 -- 172.21.15.112:0/414171763 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06cc065740 con 0x7f06a4080670 2020-11-20T11:43:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 msgr2=0x7f06a4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 0x7f06a4082b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06b8006c10 tx=0x7f06b8008040).stop 2020-11-20T11:43:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 msgr2=0x7f06cc0c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f06c40090b0 tx=0x7f06c4016000).stop 2020-11-20T11:43:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 shutdown_connections 2020-11-20T11:43:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f06a4080670 0x7f06a4082b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06cc1512e0 0x7f06cc0c1120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06cc065d30 0x7f06cc0b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 --2- 172.21.15.112:0/414171763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f06cc0bfa50 0x7f06cc1643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 >> 172.21.15.112:0/414171763 conn(0x7f06cc05bac0 msgr2=0x7f06cc0c0860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 shutdown_connections 2020-11-20T11:43:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.763+0000 7f06d2ef6700 1 -- 172.21.15.112:0/414171763 wait complete. 2020-11-20T11:43:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T11:43:36.777 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T11:43:36.778 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:36.891 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.887+0000 7fb16759e700 1 Processor -- start 2020-11-20T11:43:36.892 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.887+0000 7fb16759e700 1 -- start start 2020-11-20T11:43:36.903 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16759e700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fb1680c4f20 0x7fb1680601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.904 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168060790 con 0x7fb1680c7a10 2020-11-20T11:43:36.905 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16759e700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168060a30 con 0x7fb1680c7df0 2020-11-20T11:43:36.905 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16759e700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1680c4150 con 0x7fb1680c4f20 2020-11-20T11:43:36.905 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb1680c7a10 0x7fb1680bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35594/0 (socket says 172.21.15.112:35594) 2020-11-20T11:43:36.905 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb16659c700 1 -- 172.21.15.112:0/329124401 learned_addr learned my addr 172.21.15.112:0/329124401 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:36.906 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb166d9d700 1 --2- 172.21.15.112:0/329124401 >> v2:172.21.15.166:3300/0 conn(0x7fb1680c4f20 0x7fb1680601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.906 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867383949 0 0) 0x7fb168060790 con 0x7fb1680c7a10 2020-11-20T11:43:36.906 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.888+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb148003280 con 0x7fb1680c7a10 2020-11-20T11:43:36.906 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103530967 0 0) 0x7fb168060a30 con 0x7fb1680c7df0 2020-11-20T11:43:36.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb168060790 con 0x7fb1680c7df0 2020-11-20T11:43:36.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1956483075 0 0) 0x7fb148003280 con 0x7fb1680c7a10 2020-11-20T11:43:36.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 >> v2:172.21.15.166:3300/0 conn(0x7fb1680c4f20 msgr2=0x7fb1680601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 --2- 172.21.15.112:0/329124401 >> v2:172.21.15.166:3300/0 conn(0x7fb1680c4f20 0x7fb1680601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.907 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 >> v1:172.21.15.204:6789/0 conn(0x7fb1680c7df0 legacy=0x7fb1680c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168060cd0 con 0x7fb1680c7a10 2020-11-20T11:43:36.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fb158001520 con 0x7fb1680c7a10 2020-11-20T11:43:36.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 >> v1:172.21.15.112:6789/0 conn(0x7fb1680c7a10 legacy=0x7fb1680bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.908 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 0x7fb148003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb148004520 0x7fb1480049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148004e90 0x7fb14800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680c4150 con 0x7fb148003950 2020-11-20T11:43:36.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800bc60 con 0x7fb148004e90 2020-11-20T11:43:36.909 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800bdd0 con 0x7fb148004520 2020-11-20T11:43:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 0x7fb148003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb166d9d700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148004e90 0x7fb14800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb15ffff700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb148004520 0x7fb1480049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 -- 172.21.15.112:0/329124401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb148004520 msgr2=0x7fb1480049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb148004520 0x7fb1480049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 -- 172.21.15.112:0/329124401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148004e90 msgr2=0x7fb14800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148004e90 0x7fb14800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb166d9d700 1 -- 172.21.15.112:0/329124401 reap_dead start 2020-11-20T11:43:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 -- 172.21.15.112:0/329124401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148003280 con 0x7fb148003950 2020-11-20T11:43:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb15ffff700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb148004520 0x7fb1480049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:36.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb16659c700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 0x7fb148003d50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb15800c420 tx=0x7fb168060920).ready entity=mon.0 client_cookie=4f8dd2349190f8e0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580070d0 con 0x7fb148003950 2020-11-20T11:43:36.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158007230 con 0x7fb148003950 2020-11-20T11:43:36.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.889+0000 7fb165d9b700 1 -- 172.21.15.112:0/329124401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158005630 con 0x7fb148003950 2020-11-20T11:43:36.912 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 -- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 msgr2=0x7fb148003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 0x7fb148003d50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb15800c420 tx=0x7fb168060920).stop 2020-11-20T11:43:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 -- 172.21.15.112:0/329124401 shutdown_connections 2020-11-20T11:43:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 --2- 172.21.15.112:0/329124401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb148003950 0x7fb148003d50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 -- 172.21.15.112:0/329124401 >> 172.21.15.112:0/329124401 conn(0x7fb16805bac0 msgr2=0x7fb168062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 -- 172.21.15.112:0/329124401 shutdown_connections 2020-11-20T11:43:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.890+0000 7fb16759e700 1 -- 172.21.15.112:0/329124401 wait complete. 2020-11-20T11:43:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.891+0000 7fb16759e700 1 Processor -- start 2020-11-20T11:43:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.891+0000 7fb16759e700 1 -- start start 2020-11-20T11:43:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148003950 0x7fb168156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb168156f50 0x7fb16814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 0x7fb16814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168150400 con 0x7fb1681573d0 2020-11-20T11:43:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168160b20 con 0x7fb148003950 2020-11-20T11:43:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168160dc0 con 0x7fb168156f50 2020-11-20T11:43:36.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 0x7fb16814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb15ffff700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb168156f50 0x7fb16814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 0x7fb16814fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51416/0 (socket says 172.21.15.112:51416) 2020-11-20T11:43:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 -- 172.21.15.112:0/3277533316 learned_addr learned my addr 172.21.15.112:0/3277533316 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16659c700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148003950 0x7fb168156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 -- 172.21.15.112:0/3277533316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb168156f50 msgr2=0x7fb16814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb168156f50 0x7fb16814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 -- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148003950 msgr2=0x7fb168156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb148003950 0x7fb168156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168161060 con 0x7fb1681573d0 2020-11-20T11:43:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb166d9d700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 0x7fb16814fe70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb160009160 tx=0x7fb160009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000fa40 con 0x7fb1681573d0 2020-11-20T11:43:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000fba0 con 0x7fb1681573d0 2020-11-20T11:43:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168161300 con 0x7fb1681573d0 2020-11-20T11:43:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.892+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160014440 con 0x7fb1681573d0 2020-11-20T11:43:36.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.893+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb168156800 con 0x7fb1681573d0 2020-11-20T11:43:36.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.893+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1680008d0 con 0x7fb1681573d0 2020-11-20T11:43:36.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.894+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb160014830 con 0x7fb1681573d0 2020-11-20T11:43:36.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.894+0000 7fb15e7fc700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb1440806a0 0x7fb144082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb1600a40c0 con 0x7fb1681573d0 2020-11-20T11:43:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb16659c700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb1440806a0 0x7fb144082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15e7fc700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7fb1440893d0 0x7fb14408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb14408be50 con 0x7fb1440893d0 2020-11-20T11:43:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1600a4430 con 0x7fb1681573d0 2020-11-20T11:43:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15ffff700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7fb1440893d0 0x7fb14408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb16659c700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb1440806a0 0x7fb144082b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb158007900 tx=0x7fb158013000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.895+0000 7fb15ffff700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7fb1440893d0 0x7fb14408b7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.896+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== osd.3 v2:172.21.15.112:6808/23141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fb14408be50 con 0x7fb1440893d0 2020-11-20T11:43:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.909+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 --> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb16814edf0 con 0x7fb1440893d0 2020-11-20T11:43:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.909+0000 7fb15e7fc700 1 -- 172.21.15.112:0/3277533316 <== osd.3 v2:172.21.15.112:6808/23141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb16814edf0 con 0x7fb1440893d0 2020-11-20T11:43:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.909+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7fb1440893d0 msgr2=0x7fb14408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.909+0000 7fb16759e700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:6808/23141,v1:172.21.15.112:6809/23141] conn(0x7fb1440893d0 0x7fb14408b7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.909+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb1440806a0 msgr2=0x7fb144082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb1440806a0 0x7fb144082b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb158007900 tx=0x7fb158013000).stop 2020-11-20T11:43:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 msgr2=0x7fb16814fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 --2- 172.21.15.112:0/3277533316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1681573d0 0x7fb16814fe70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb160009160 tx=0x7fb160009220).stop 2020-11-20T11:43:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb166d9d700 1 -- 172.21.15.112:0/3277533316 reap_dead start 2020-11-20T11:43:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 shutdown_connections 2020-11-20T11:43:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 >> 172.21.15.112:0/3277533316 conn(0x7fb16805bac0 msgr2=0x7fb168151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 shutdown_connections 2020-11-20T11:43:36.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:36.910+0000 7fb16759e700 1 -- 172.21.15.112:0/3277533316 wait complete. 2020-11-20T11:43:36.932 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:36.932 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:36.932 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:36.933 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T11:43:37.043 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 Processor -- start 2020-11-20T11:43:37.044 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 -- start start 2020-11-20T11:43:37.052 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1e4065d30 0x7fc1e4066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.053 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 0x7fc1e4151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.053 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40c5230 con 0x7fc1e40bfa50 2020-11-20T11:43:37.054 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e41549c0 con 0x7fc1e4065d30 2020-11-20T11:43:37.054 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.040+0000 7fc1e93b3700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e4154c60 con 0x7fc1e41512e0 2020-11-20T11:43:37.054 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1e4065d30 0x7fc1e4066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.055 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1e4065d30 0x7fc1e4066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51424/0 (socket says 172.21.15.112:51424) 2020-11-20T11:43:37.055 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/1137565055 learned_addr learned my addr 172.21.15.112:0/1137565055 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.056 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/1137565055 >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 0x7fc1e4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.056 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/1137565055 >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 msgr2=0x7fc1e4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.056 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 --2- 172.21.15.112:0/1137565055 >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 0x7fc1e4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/1137565055 >> v1:172.21.15.166:6789/0 conn(0x7fc1e40bfa50 legacy=0x7fc1e40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/1137565055 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4154f00 con 0x7fc1e4065d30 2020-11-20T11:43:37.057 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/1137565055 >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 0x7fc1e4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:37.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e2ffd700 1 --2- 172.21.15.112:0/1137565055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e4065d30 0x7fc1e4066110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc1e40651b0 tx=0x7fc1d8006ef0).ready entity=mon.0 client_cookie=dfc7e943fc2a2c7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.058 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e1ffb700 1 -- 172.21.15.112:0/1137565055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800b820 con 0x7fc1e4065d30 2020-11-20T11:43:37.059 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e1ffb700 1 -- 172.21.15.112:0/1137565055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8000e90 con 0x7fc1e4065d30 2020-11-20T11:43:37.059 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.041+0000 7fc1e1ffb700 1 -- 172.21.15.112:0/1137565055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800bb90 con 0x7fc1e4065d30 2020-11-20T11:43:37.059 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 -- 172.21.15.112:0/1137565055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e4065d30 msgr2=0x7fc1e4066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.060 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/1137565055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e4065d30 0x7fc1e4066110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc1e40651b0 tx=0x7fc1d8006ef0).stop 2020-11-20T11:43:37.060 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 -- 172.21.15.112:0/1137565055 shutdown_connections 2020-11-20T11:43:37.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/1137565055 >> v2:172.21.15.204:3300/0 conn(0x7fc1e41512e0 0x7fc1e4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/1137565055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e4065d30 0x7fc1e4066110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 -- 172.21.15.112:0/1137565055 >> 172.21.15.112:0/1137565055 conn(0x7fc1e405bac0 msgr2=0x7fc1e405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 -- 172.21.15.112:0/1137565055 shutdown_connections 2020-11-20T11:43:37.062 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.042+0000 7fc1e93b3700 1 -- 172.21.15.112:0/1137565055 wait complete. 2020-11-20T11:43:37.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.043+0000 7fc1e93b3700 1 Processor -- start 2020-11-20T11:43:37.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.043+0000 7fc1e93b3700 1 -- start start 2020-11-20T11:43:37.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1e4065d30 0x7fc1e4164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc1e41512e0 0x7fc1e40b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4164c20 con 0x7fc1e40bfa50 2020-11-20T11:43:37.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4161d90 con 0x7fc1e41512e0 2020-11-20T11:43:37.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4162030 con 0x7fc1e4065d30 2020-11-20T11:43:37.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51430/0 (socket says 172.21.15.112:51430) 2020-11-20T11:43:37.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 -- 172.21.15.112:0/216118026 learned_addr learned my addr 172.21.15.112:0/216118026 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e2ffd700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1e4065d30 0x7fc1e4164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc1e41512e0 0x7fc1e40b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 -- 172.21.15.112:0/216118026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1e4065d30 msgr2=0x7fc1e4164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1e4065d30 0x7fc1e4164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 -- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc1e41512e0 msgr2=0x7fc1e40b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc1e41512e0 0x7fc1e40b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 -- 172.21.15.112:0/216118026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e41622d0 con 0x7fc1e40bfa50 2020-11-20T11:43:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e27fc700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc1d4009690 tx=0x7fc1d4006db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400d4a0 con 0x7fc1e40bfa50 2020-11-20T11:43:37.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d400d620 con 0x7fc1e40bfa50 2020-11-20T11:43:37.071 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e4162570 con 0x7fc1e40bfa50 2020-11-20T11:43:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400d9e0 con 0x7fc1e40bfa50 2020-11-20T11:43:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.044+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e4162ab0 con 0x7fc1e40bfa50 2020-11-20T11:43:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.045+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4065740 con 0x7fc1e40bfa50 2020-11-20T11:43:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.046+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc1d401a060 con 0x7fc1e40bfa50 2020-11-20T11:43:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.046+0000 7fc1caffd700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 0x7fc1c0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.046+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc1d40a22f0 con 0x7fc1e40bfa50 2020-11-20T11:43:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.047+0000 7fc1e2ffd700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 0x7fc1c0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.047+0000 7fc1e2ffd700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 0x7fc1c0082b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc1d8006f30 tx=0x7fc1d8016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.050+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc1d4076d00 con 0x7fc1e40bfa50 2020-11-20T11:43:37.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.197+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e40666c0 con 0x7fc1c00806a0 2020-11-20T11:43:37.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.197+0000 7fc1caffd700 1 -- 172.21.15.112:0/216118026 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc1e40666c0 con 0x7fc1c00806a0 2020-11-20T11:43:37.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 msgr2=0x7fc1c0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 0x7fc1c0082b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc1d8006f30 tx=0x7fc1d8016000).stop 2020-11-20T11:43:37.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 msgr2=0x7fc1e414db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc1d4009690 tx=0x7fc1d4006db0).stop 2020-11-20T11:43:37.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 shutdown_connections 2020-11-20T11:43:37.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fc1c00806a0 0x7fc1c0082b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc1e41512e0 0x7fc1e40b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1e4065d30 0x7fc1e4164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 --2- 172.21.15.112:0/216118026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40bfa50 0x7fc1e414db60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 >> 172.21.15.112:0/216118026 conn(0x7fc1e405bac0 msgr2=0x7fc1e4152600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 shutdown_connections 2020-11-20T11:43:37.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.199+0000 7fc1e93b3700 1 -- 172.21.15.112:0/216118026 wait complete. 2020-11-20T11:43:37.206 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T11:43:37.214 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T11:43:37.214 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.322+0000 7f536e0f3700 1 Processor -- start 2020-11-20T11:43:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.322+0000 7f536e0f3700 1 -- start start 2020-11-20T11:43:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536e0f3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53680c7df0 0x7f53680601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536e0f3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5368060790 con 0x7f53680c7a10 2020-11-20T11:43:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536e0f3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5368060a30 con 0x7f53680c4810 2020-11-20T11:43:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536e0f3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680c4150 con 0x7f53680c7df0 2020-11-20T11:43:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53680c7df0 0x7f53680601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53680c7df0 0x7f53680601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51436/0 (socket says 172.21.15.112:51436) 2020-11-20T11:43:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 -- 172.21.15.112:0/3438106494 learned_addr learned my addr 172.21.15.112:0/3438106494 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536d0f1700 1 --1- 172.21.15.112:0/3438106494 >> v1:172.21.15.112:6789/0 conn(0x7f53680c7a10 0x7f53680bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35630/0 (socket says 172.21.15.112:35630) 2020-11-20T11:43:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 -- 172.21.15.112:0/3438106494 >> v1:172.21.15.166:6789/0 conn(0x7f53680c4810 legacy=0x7f53680c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 -- 172.21.15.112:0/3438106494 >> v1:172.21.15.112:6789/0 conn(0x7f53680c7a10 legacy=0x7f53680bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f536c8f0700 1 -- 172.21.15.112:0/3438106494 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368060cd0 con 0x7f53680c7df0 2020-11-20T11:43:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.323+0000 7f5357fff700 1 -- 172.21.15.112:0/3438106494 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532003999 0 0) 0x7f5368060790 con 0x7f53680c7a10 2020-11-20T11:43:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536c8f0700 1 --2- 172.21.15.112:0/3438106494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7df0 0x7f53680601b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5358009a10 tx=0x7f5358006ef0).ready entity=mon.0 client_cookie=7156e05137e806ea server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f5357fff700 1 -- 172.21.15.112:0/3438106494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800b860 con 0x7f53680c7df0 2020-11-20T11:43:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f5357fff700 1 -- 172.21.15.112:0/3438106494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358000e90 con 0x7f53680c7df0 2020-11-20T11:43:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f5357fff700 1 -- 172.21.15.112:0/3438106494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800bbd0 con 0x7f53680c7df0 2020-11-20T11:43:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 -- 172.21.15.112:0/3438106494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7df0 msgr2=0x7f53680601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 --2- 172.21.15.112:0/3438106494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7df0 0x7f53680601b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5358009a10 tx=0x7f5358006ef0).stop 2020-11-20T11:43:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 -- 172.21.15.112:0/3438106494 shutdown_connections 2020-11-20T11:43:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 --2- 172.21.15.112:0/3438106494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7df0 0x7f53680601b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 -- 172.21.15.112:0/3438106494 >> 172.21.15.112:0/3438106494 conn(0x7f536805bac0 msgr2=0x7f5368062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 -- 172.21.15.112:0/3438106494 shutdown_connections 2020-11-20T11:43:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.324+0000 7f536e0f3700 1 -- 172.21.15.112:0/3438106494 wait complete. 2020-11-20T11:43:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.325+0000 7f536e0f3700 1 Processor -- start 2020-11-20T11:43:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.325+0000 7f536e0f3700 1 -- start start 2020-11-20T11:43:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53680c4810 0x7f53681546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 0x7f53680bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f53680c7df0 0x7f536814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368163c40 con 0x7f53680c7a10 2020-11-20T11:43:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368164af0 con 0x7f53680c7df0 2020-11-20T11:43:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536e0f3700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368154e70 con 0x7f53680c4810 2020-11-20T11:43:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536c8f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 0x7f53680bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536c8f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 0x7f53680bbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51444/0 (socket says 172.21.15.112:51444) 2020-11-20T11:43:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536c8f0700 1 -- 172.21.15.112:0/1826367884 learned_addr learned my addr 172.21.15.112:0/1826367884 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536d0f1700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53680c4810 0x7f53681546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.326+0000 7f536d8f2700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f53680c7df0 0x7f536814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 -- 172.21.15.112:0/1826367884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53680c4810 msgr2=0x7f53681546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53680c4810 0x7f53681546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 -- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f53680c7df0 msgr2=0x7f536814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f53680c7df0 0x7f536814fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368163e70 con 0x7f53680c7a10 2020-11-20T11:43:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536d8f2700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f53680c7df0 0x7f536814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536c8f0700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 0x7f53680bbec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f53680645d0 tx=0x7f5358016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011e80 con 0x7f53680c7a10 2020-11-20T11:43:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535801d450 con 0x7f53680c7a10 2020-11-20T11:43:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5368164110 con 0x7f53680c7a10 2020-11-20T11:43:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801d7d0 con 0x7f53680c7a10 2020-11-20T11:43:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.327+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368164650 con 0x7f53680c7a10 2020-11-20T11:43:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.328+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5368154bc0 con 0x7f53680c7a10 2020-11-20T11:43:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5358017040 con 0x7f53680c7a10 2020-11-20T11:43:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5340080670 0x7f5340082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f53580a4d30 con 0x7f53680c7a10 2020-11-20T11:43:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f53400893a0 0x7f534008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f534008be20 con 0x7f53400893a0 2020-11-20T11:43:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53580a50a0 con 0x7f53680c7a10 2020-11-20T11:43:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f536d0f1700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5340080670 0x7f5340082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.329+0000 7f536d8f2700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f53400893a0 0x7f534008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.330+0000 7f536d0f1700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5340080670 0x7f5340082b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f53640011e0 tx=0x7f5364007a40).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.330+0000 7f536d8f2700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f53400893a0 0x7f534008b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.330+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== osd.6 v2:172.21.15.112:6816/23142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f534008be20 con 0x7f53400893a0 2020-11-20T11:43:37.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.343+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 --> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5368164850 con 0x7f53400893a0 2020-11-20T11:43:37.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.343+0000 7f53557fa700 1 -- 172.21.15.112:0/1826367884 <== osd.6 v2:172.21.15.112:6816/23142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f53600040f0 con 0x7f53400893a0 2020-11-20T11:43:37.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f53400893a0 msgr2=0x7f534008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:6816/23142,v1:172.21.15.112:6817/23142] conn(0x7f53400893a0 0x7f534008b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5340080670 msgr2=0x7f5340082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5340080670 0x7f5340082b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f53640011e0 tx=0x7f5364007a40).stop 2020-11-20T11:43:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 msgr2=0x7f53680bbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 --2- 172.21.15.112:0/1826367884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53680c7a10 0x7f53680bbec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f53680645d0 tx=0x7f5358016000).stop 2020-11-20T11:43:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536d8f2700 1 -- 172.21.15.112:0/1826367884 reap_dead start 2020-11-20T11:43:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 shutdown_connections 2020-11-20T11:43:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 >> 172.21.15.112:0/1826367884 conn(0x7f536805bac0 msgr2=0x7f53680c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 shutdown_connections 2020-11-20T11:43:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.344+0000 7f536e0f3700 1 -- 172.21.15.112:0/1826367884 wait complete. 2020-11-20T11:43:37.351 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:37.352 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:37.358 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T11:43:37.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.464+0000 7f706ddd2700 1 Processor -- start 2020-11-20T11:43:37.468 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.464+0000 7f706ddd2700 1 -- start start 2020-11-20T11:43:37.470 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f706ddd2700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7068064b90 0x7f7068064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.471 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f706ddd2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f706814a870 0x7f706814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.471 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f706ddd2700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706814d8a0 con 0x7f7068060f10 2020-11-20T11:43:37.471 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f706ddd2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706814b1a0 con 0x7f706814a870 2020-11-20T11:43:37.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f706ddd2700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7068151110 con 0x7f7068064b90 2020-11-20T11:43:37.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f7067fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f706814a870 0x7f706814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f7067fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f706814a870 0x7f706814acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51454/0 (socket says 172.21.15.112:51454) 2020-11-20T11:43:37.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f7067fff700 1 -- 172.21.15.112:0/3690873916 learned_addr learned my addr 172.21.15.112:0/3690873916 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.472 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.465+0000 7f70677fe700 1 --2- 172.21.15.112:0/3690873916 >> v2:172.21.15.204:3300/0 conn(0x7f7068064b90 0x7f7068064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f7067fff700 1 -- 172.21.15.112:0/3690873916 >> v2:172.21.15.204:3300/0 conn(0x7f7068064b90 msgr2=0x7f7068064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f7067fff700 1 --2- 172.21.15.112:0/3690873916 >> v2:172.21.15.204:3300/0 conn(0x7f7068064b90 0x7f7068064f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f7067fff700 1 -- 172.21.15.112:0/3690873916 >> v1:172.21.15.166:6789/0 conn(0x7f7068060f10 legacy=0x7f70680bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f7067fff700 1 -- 172.21.15.112:0/3690873916 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70681513b0 con 0x7f706814a870 2020-11-20T11:43:37.473 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f7067fff700 1 --2- 172.21.15.112:0/3690873916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f706814acb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f70680c35e0 tx=0x7f70600092d0).ready entity=mon.0 client_cookie=76d075f3049f335c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f70667fc700 1 -- 172.21.15.112:0/3690873916 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706000bbb0 con 0x7f706814a870 2020-11-20T11:43:37.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f70667fc700 1 -- 172.21.15.112:0/3690873916 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706000bd10 con 0x7f706814a870 2020-11-20T11:43:37.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f70667fc700 1 -- 172.21.15.112:0/3690873916 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060010620 con 0x7f706814a870 2020-11-20T11:43:37.474 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 -- 172.21.15.112:0/3690873916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 msgr2=0x7f706814acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3690873916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f706814acb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f70680c35e0 tx=0x7f70600092d0).stop 2020-11-20T11:43:37.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 -- 172.21.15.112:0/3690873916 shutdown_connections 2020-11-20T11:43:37.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3690873916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f706814acb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.475 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3690873916 >> v2:172.21.15.204:3300/0 conn(0x7f7068064b90 0x7f7068064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 -- 172.21.15.112:0/3690873916 >> 172.21.15.112:0/3690873916 conn(0x7f706805bac0 msgr2=0x7f706805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 -- 172.21.15.112:0/3690873916 shutdown_connections 2020-11-20T11:43:37.476 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.466+0000 7f706ddd2700 1 -- 172.21.15.112:0/3690873916 wait complete. 2020-11-20T11:43:37.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.467+0000 7f706ddd2700 1 Processor -- start 2020-11-20T11:43:37.477 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.467+0000 7f706ddd2700 1 -- start start 2020-11-20T11:43:37.482 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7068060f10 0x7f706814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7068064b90 0x7f70680bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.483 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70680ada50 con 0x7f706814a870 2020-11-20T11:43:37.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70680ac200 con 0x7f7068064b90 2020-11-20T11:43:37.484 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f706ddd2700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70680ac4a0 con 0x7f7068060f10 2020-11-20T11:43:37.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f7067fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f7067fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51462/0 (socket says 172.21.15.112:51462) 2020-11-20T11:43:37.485 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f7067fff700 1 -- 172.21.15.112:0/3131037000 learned_addr learned my addr 172.21.15.112:0/3131037000 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f7066ffd700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7068064b90 0x7f70680bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.468+0000 7f70677fe700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7068060f10 0x7f706814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.486 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 -- 172.21.15.112:0/3131037000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7068060f10 msgr2=0x7f706814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7068060f10 0x7f706814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 -- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7068064b90 msgr2=0x7f70680bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7068064b90 0x7f70680bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 -- 172.21.15.112:0/3131037000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680adc40 con 0x7f706814a870 2020-11-20T11:43:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f7067fff700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f7068062ff0 tx=0x7f7060017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706001a730 con 0x7f706814a870 2020-11-20T11:43:37.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706001e070 con 0x7f706814a870 2020-11-20T11:43:37.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706001a890 con 0x7f706814a870 2020-11-20T11:43:37.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70680adee0 con 0x7f706814a870 2020-11-20T11:43:37.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.469+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70680abf30 con 0x7f706814a870 2020-11-20T11:43:37.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.470+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70680ae340 con 0x7f706814a870 2020-11-20T11:43:37.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.470+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f706000e040 con 0x7f706814a870 2020-11-20T11:43:37.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.471+0000 7f70477fe700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 0x7f7040082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.471+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f70600a48d0 con 0x7f706814a870 2020-11-20T11:43:37.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.471+0000 7f70677fe700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 0x7f7040082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.471+0000 7f70677fe700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 0x7f7040082b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7058006fd0 tx=0x7f7058008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.474+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f70600792e0 con 0x7f706814a870 2020-11-20T11:43:37.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.616+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f70680ac740 con 0x7f7040080670 2020-11-20T11:43:37.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.617+0000 7f70477fe700 1 -- 172.21.15.112:0/3131037000 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70680ac740 con 0x7f7040080670 2020-11-20T11:43:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 msgr2=0x7f7040082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 0x7f7040082b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7058006fd0 tx=0x7f7058008040).stop 2020-11-20T11:43:37.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 msgr2=0x7f7068145630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f7068062ff0 tx=0x7f7060017000).stop 2020-11-20T11:43:37.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 shutdown_connections 2020-11-20T11:43:37.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7040080670 0x7f7040082b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f706814a870 0x7f7068145630 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7068060f10 0x7f706814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 --2- 172.21.15.112:0/3131037000 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7068064b90 0x7f70680bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 >> 172.21.15.112:0/3131037000 conn(0x7f706805bac0 msgr2=0x7f706805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 shutdown_connections 2020-11-20T11:43:37.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.618+0000 7f706ddd2700 1 -- 172.21.15.112:0/3131037000 wait complete. 2020-11-20T11:43:37.626 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T11:43:37.633 INFO:tasks.ceph:Scrubbing osd.9 2020-11-20T11:43:37.634 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:37.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.744+0000 7f02b9074700 1 Processor -- start 2020-11-20T11:43:37.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.744+0000 7f02b9074700 1 -- start start 2020-11-20T11:43:37.757 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.744+0000 7f02b9074700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f02b4065d30 0x7f02b4066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b9074700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b40c5230 con 0x7f02b41512e0 2020-11-20T11:43:37.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b9074700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b41549c0 con 0x7f02b40bfa50 2020-11-20T11:43:37.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b9074700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b4154c60 con 0x7f02b4065d30 2020-11-20T11:43:37.758 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f02b4065d30 0x7f02b4066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f02b4065d30 0x7f02b4066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:39462/0 (socket says 172.21.15.112:39462) 2020-11-20T11:43:37.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 -- 172.21.15.112:0/4119695930 learned_addr learned my addr 172.21.15.112:0/4119695930 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b359e700 1 --1- 172.21.15.112:0/4119695930 >> v1:172.21.15.166:6789/0 conn(0x7f02b41512e0 0x7f02b4151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:46316/0 (socket says 172.21.15.112:46316) 2020-11-20T11:43:37.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247848207 0 0) 0x7f02b41549c0 con 0x7f02b40bfa50 2020-11-20T11:43:37.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0003280 con 0x7f02b40bfa50 2020-11-20T11:43:37.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356537961 0 0) 0x7f02b40c5230 con 0x7f02b41512e0 2020-11-20T11:43:37.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 -- 172.21.15.112:0/4119695930 >> v1:172.21.15.204:6789/0 conn(0x7f02b40bfa50 legacy=0x7f02b40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 -- 172.21.15.112:0/4119695930 >> v1:172.21.15.166:6789/0 conn(0x7f02b41512e0 legacy=0x7f02b4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.760 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 -- 172.21.15.112:0/4119695930 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4154f00 con 0x7f02b4065d30 2020-11-20T11:43:37.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.745+0000 7f02b2d9d700 1 --2- 172.21.15.112:0/4119695930 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b4065d30 0x7f02b4066110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f02a8009a10 tx=0x7f02a8006ef0).ready entity=mon.1 client_cookie=80d7a0fe15b8d320 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800b860 con 0x7f02b4065d30 2020-11-20T11:43:37.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8000e90 con 0x7f02b4065d30 2020-11-20T11:43:37.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b1d9b700 1 -- 172.21.15.112:0/4119695930 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800bbd0 con 0x7f02b4065d30 2020-11-20T11:43:37.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 -- 172.21.15.112:0/4119695930 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b4065d30 msgr2=0x7f02b4066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 --2- 172.21.15.112:0/4119695930 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b4065d30 0x7f02b4066110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f02a8009a10 tx=0x7f02a8006ef0).stop 2020-11-20T11:43:37.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 -- 172.21.15.112:0/4119695930 shutdown_connections 2020-11-20T11:43:37.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 --2- 172.21.15.112:0/4119695930 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b4065d30 0x7f02b4066110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 -- 172.21.15.112:0/4119695930 >> 172.21.15.112:0/4119695930 conn(0x7f02b405bac0 msgr2=0x7f02b405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 -- 172.21.15.112:0/4119695930 shutdown_connections 2020-11-20T11:43:37.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.746+0000 7f02b9074700 1 -- 172.21.15.112:0/4119695930 wait complete. 2020-11-20T11:43:37.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.747+0000 7f02b9074700 1 Processor -- start 2020-11-20T11:43:37.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.747+0000 7f02b9074700 1 -- start start 2020-11-20T11:43:37.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b40bfa50 0x7f02b4161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 0x7f02b4163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02b414ca10 0x7f02b4160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.772 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40be640 con 0x7f02b41512e0 2020-11-20T11:43:37.772 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b41643b0 con 0x7f02b40bfa50 2020-11-20T11:43:37.773 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b9074700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4164650 con 0x7f02b414ca10 2020-11-20T11:43:37.773 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 0x7f02b4163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 0x7f02b4163bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51476/0 (socket says 172.21.15.112:51476) 2020-11-20T11:43:37.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 -- 172.21.15.112:0/572091986 learned_addr learned my addr 172.21.15.112:0/572091986 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b359e700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02b414ca10 0x7f02b4160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b2d9d700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b40bfa50 0x7f02b4161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 -- 172.21.15.112:0/572091986 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02b414ca10 msgr2=0x7f02b4160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02b414ca10 0x7f02b4160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.780 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 -- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b40bfa50 msgr2=0x7f02b4161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.780 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f02b40bfa50 0x7f02b4161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.781 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.748+0000 7f02b259c700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b41648f0 con 0x7f02b41512e0 2020-11-20T11:43:37.781 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f02b259c700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 0x7f02b4163bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f02a400c710 tx=0x7f02a4007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400f470 con 0x7f02b41512e0 2020-11-20T11:43:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400f5d0 con 0x7f02b41512e0 2020-11-20T11:43:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b4160870 con 0x7f02b41512e0 2020-11-20T11:43:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400f970 con 0x7f02b41512e0 2020-11-20T11:43:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b41640c0 con 0x7f02b41512e0 2020-11-20T11:43:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.749+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02b41606a0 con 0x7f02b41512e0 2020-11-20T11:43:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.750+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f02a4019030 con 0x7f02b41512e0 2020-11-20T11:43:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f029affd700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0290080670 0x7f0290082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.786 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f02a40a2650 con 0x7f02b41512e0 2020-11-20T11:43:37.786 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f029affd700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f02900893a0 0x7f029008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f029008be20 con 0x7f02900893a0 2020-11-20T11:43:37.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02a40a2980 con 0x7f02b41512e0 2020-11-20T11:43:37.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f02b359e700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f02900893a0 0x7f029008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.787 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.751+0000 7f02b2d9d700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0290080670 0x7f0290082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.752+0000 7f02b359e700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f02900893a0 0x7f029008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.752+0000 7f02b2d9d700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0290080670 0x7f0290082b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f02b405d710 tx=0x7f02a8015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.788 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.752+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== osd.9 v2:172.21.15.112:6818/23143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f029008be20 con 0x7f02900893a0 2020-11-20T11:43:37.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 --> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02b4160cd0 con 0x7f02900893a0 2020-11-20T11:43:37.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f029affd700 1 -- 172.21.15.112:0/572091986 <== osd.9 v2:172.21.15.112:6818/23143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f02b4160cd0 con 0x7f02900893a0 2020-11-20T11:43:37.793 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f02900893a0 msgr2=0x7f029008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:6818/23143,v1:172.21.15.112:6819/23143] conn(0x7f02900893a0 0x7f029008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.794 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0290080670 msgr2=0x7f0290082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f0290080670 0x7f0290082b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f02b405d710 tx=0x7f02a8015000).stop 2020-11-20T11:43:37.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 msgr2=0x7f02b4163bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.795 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b9074700 1 --2- 172.21.15.112:0/572091986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b41512e0 0x7f02b4163bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f02a400c710 tx=0x7f02a4007b20).stop 2020-11-20T11:43:37.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.765+0000 7f02b359e700 1 -- 172.21.15.112:0/572091986 reap_dead start 2020-11-20T11:43:37.796 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.766+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 shutdown_connections 2020-11-20T11:43:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.766+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 >> 172.21.15.112:0/572091986 conn(0x7f02b405bac0 msgr2=0x7f02b40c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.766+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 shutdown_connections 2020-11-20T11:43:37.797 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.766+0000 7f02b9074700 1 -- 172.21.15.112:0/572091986 wait complete. 2020-11-20T11:43:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:37.798 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:37.799 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:37.799 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2020-11-20T11:43:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.907+0000 7f539fb5c700 1 Processor -- start 2020-11-20T11:43:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.907+0000 7f539fb5c700 1 -- start start 2020-11-20T11:43:37.914 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539fb5c700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53980bdc10 0x7f5398158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539fb5c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53980c11d0 con 0x7f5398061ad0 2020-11-20T11:43:37.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539fb5c700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53980c1470 con 0x7f53980616f0 2020-11-20T11:43:37.915 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539fb5c700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980c1710 con 0x7f53980bdc10 2020-11-20T11:43:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539d0f7700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5398061ad0 0x7f5398154c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35678/0 (socket says 172.21.15.112:35678) 2020-11-20T11:43:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539d0f7700 1 -- 172.21.15.112:0/1348982009 learned_addr learned my addr 172.21.15.112:0/1348982009 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.908+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> v2:172.21.15.204:3300/0 conn(0x7f53980bdc10 0x7f5398158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860277350 0 0) 0x7f53980c11d0 con 0x7f5398061ad0 2020-11-20T11:43:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5380003280 con 0x7f5398061ad0 2020-11-20T11:43:37.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1887449248 0 0) 0x7f5380003280 con 0x7f5398061ad0 2020-11-20T11:43:37.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 >> v2:172.21.15.204:3300/0 conn(0x7f53980bdc10 msgr2=0x7f5398158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 --2- 172.21.15.112:0/1348982009 >> v2:172.21.15.204:3300/0 conn(0x7f53980bdc10 0x7f5398158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.917 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 >> v1:172.21.15.166:6789/0 conn(0x7f53980616f0 legacy=0x7f53980bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980c19b0 con 0x7f5398061ad0 2020-11-20T11:43:37.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f5388001520 con 0x7f5398061ad0 2020-11-20T11:43:37.918 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 >> v1:172.21.15.112:6789/0 conn(0x7f5398061ad0 legacy=0x7f5398154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5380003770 0x7f5380003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5380004520 0x7f53800049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f538000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53980c1710 con 0x7f5380004e90 2020-11-20T11:43:37.919 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5380004260 con 0x7f5380003770 2020-11-20T11:43:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538000bc60 con 0x7f5380004520 2020-11-20T11:43:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> v2:172.21.15.204:3300/0 conn(0x7f53980bdc10 0x7f5398158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f538000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539d8f8700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5380003770 0x7f5380003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539d0f7700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5380004520 0x7f53800049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 -- 172.21.15.112:0/1348982009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5380004520 msgr2=0x7f53800049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5380004520 0x7f53800049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 -- 172.21.15.112:0/1348982009 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5380003770 msgr2=0x7f5380003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5380003770 0x7f5380003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 -- 172.21.15.112:0/1348982009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380003280 con 0x7f5380004e90 2020-11-20T11:43:37.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 -- 172.21.15.112:0/1348982009 reap_dead start 2020-11-20T11:43:37.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.909+0000 7f539e0f9700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f538000b770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f539000e320 tx=0x7f5390009220).ready entity=mon.0 client_cookie=3a84a3bcca21caf5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390009850 con 0x7f5380004e90 2020-11-20T11:43:37.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539000ee60 con 0x7f5380004e90 2020-11-20T11:43:37.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539c8f6700 1 -- 172.21.15.112:0/1348982009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390012600 con 0x7f5380004e90 2020-11-20T11:43:37.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 -- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 msgr2=0x7f538000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f538000b770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f539000e320 tx=0x7f5390009220).stop 2020-11-20T11:43:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 -- 172.21.15.112:0/1348982009 shutdown_connections 2020-11-20T11:43:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 --2- 172.21.15.112:0/1348982009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f538000b770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 -- 172.21.15.112:0/1348982009 >> 172.21.15.112:0/1348982009 conn(0x7f53980bac60 msgr2=0x7f53980bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 -- 172.21.15.112:0/1348982009 shutdown_connections 2020-11-20T11:43:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.910+0000 7f539fb5c700 1 -- 172.21.15.112:0/1348982009 wait complete. 2020-11-20T11:43:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.911+0000 7f539fb5c700 1 Processor -- start 2020-11-20T11:43:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.911+0000 7f539fb5c700 1 -- start start 2020-11-20T11:43:37.938 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.939 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5398151ee0 0x7f5398145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5398146100 0x7f539815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.940 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5398160700 con 0x7f5380004e90 2020-11-20T11:43:37.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5398142960 con 0x7f5398151ee0 2020-11-20T11:43:37.941 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539fb5c700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539814f420 con 0x7f5398146100 2020-11-20T11:43:37.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51496/0 (socket says 172.21.15.112:51496) 2020-11-20T11:43:37.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 -- 172.21.15.112:0/3854532729 learned_addr learned my addr 172.21.15.112:0/3854532729 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:37.942 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539e0f9700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5398146100 0x7f539815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.943 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d0f7700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5398151ee0 0x7f5398145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.943 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 -- 172.21.15.112:0/3854532729 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5398146100 msgr2=0x7f539815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.943 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5398146100 0x7f539815c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.943 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 -- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5398151ee0 msgr2=0x7f5398145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:37.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5398151ee0 0x7f5398145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:37.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 -- 172.21.15.112:0/3854532729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398149c10 con 0x7f5380004e90 2020-11-20T11:43:37.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.912+0000 7f539d8f8700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f5394002ca0 tx=0x7f5394007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400fa30 con 0x7f5380004e90 2020-11-20T11:43:37.944 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539400fb90 con 0x7f5380004e90 2020-11-20T11:43:37.945 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539814f8f0 con 0x7f5380004e90 2020-11-20T11:43:37.945 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394014450 con 0x7f5380004e90 2020-11-20T11:43:37.945 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5398151110 con 0x7f5380004e90 2020-11-20T11:43:37.945 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.913+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539805d370 con 0x7f5380004e90 2020-11-20T11:43:37.946 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.914+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f539401b030 con 0x7f5380004e90 2020-11-20T11:43:37.946 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.914+0000 7f5385ffb700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 0x7f5370082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:37.946 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.915+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f53940a27b0 con 0x7f5380004e90 2020-11-20T11:43:37.946 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.915+0000 7f539d0f7700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 0x7f5370082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:37.946 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.915+0000 7f539d0f7700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 0x7f5370082b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5388007890 tx=0x7f5388009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:37.947 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:37.918+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5394045fd0 con 0x7f5380004e90 2020-11-20T11:43:38.063 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.059+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7f539815c2a0 con 0x7f5370080670 2020-11-20T11:43:38.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.060+0000 7f5385ffb700 1 -- 172.21.15.112:0/3854532729 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5388007430 con 0x7f5370080670 2020-11-20T11:43:38.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.061+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 msgr2=0x7f5370082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.061+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 0x7f5370082b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5388007890 tx=0x7f5388009040).stop 2020-11-20T11:43:38.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.061+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 msgr2=0x7f5398160210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.061+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f5394002ca0 tx=0x7f5394007bb0).stop 2020-11-20T11:43:38.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 shutdown_connections 2020-11-20T11:43:38.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5370080670 0x7f5370082b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5398146100 0x7f539815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380004e90 0x7f5398160210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 --2- 172.21.15.112:0/3854532729 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5398151ee0 0x7f5398145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 >> 172.21.15.112:0/3854532729 conn(0x7f53980bac60 msgr2=0x7f53980636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 shutdown_connections 2020-11-20T11:43:38.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.062+0000 7f539fb5c700 1 -- 172.21.15.112:0/3854532729 wait complete. 2020-11-20T11:43:38.071 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 9 to deep-scrub 2020-11-20T11:43:38.077 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T11:43:38.077 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:38.190 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.187+0000 7ff569add700 1 Processor -- start 2020-11-20T11:43:38.191 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.187+0000 7ff569add700 1 -- start start 2020-11-20T11:43:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.187+0000 7ff569add700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5640c7a10 0x7ff5640c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff569add700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff5640c4810 0x7ff5640c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff569add700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff564060790 con 0x7ff5640601b0 2020-11-20T11:43:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff569add700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640c4150 con 0x7ff5640c4810 2020-11-20T11:43:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff569add700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff564060a30 con 0x7ff5640c7a10 2020-11-20T11:43:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5640c7a10 0x7ff5640c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff563fff700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ff5640601b0 0x7ff5640bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:45822/0 (socket says 172.21.15.112:45822) 2020-11-20T11:43:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff563fff700 1 -- 172.21.15.112:0/2576663366 learned_addr learned my addr 172.21.15.112:0/2576663366 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5640c7a10 0x7ff5640c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:37282/0 (socket says 172.21.15.112:37282) 2020-11-20T11:43:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff5692dc700 1 --2- 172.21.15.112:0/2576663366 >> v2:172.21.15.166:3300/0 conn(0x7ff5640c4810 0x7ff5640c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 -- 172.21.15.112:0/2576663366 >> v2:172.21.15.166:3300/0 conn(0x7ff5640c4810 msgr2=0x7ff5640c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 --2- 172.21.15.112:0/2576663366 >> v2:172.21.15.166:3300/0 conn(0x7ff5640c4810 0x7ff5640c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 -- 172.21.15.112:0/2576663366 >> v1:172.21.15.204:6789/0 conn(0x7ff5640601b0 legacy=0x7ff5640bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff5637fe700 1 -- 172.21.15.112:0/2576663366 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237484015 0 0) 0x7ff564060790 con 0x7ff5640601b0 2020-11-20T11:43:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 -- 172.21.15.112:0/2576663366 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564060cd0 con 0x7ff5640c7a10 2020-11-20T11:43:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff568adb700 1 --2- 172.21.15.112:0/2576663366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c7a10 0x7ff5640c7df0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff5640619c0 tx=0x7ff558006e30).ready entity=mon.2 client_cookie=5c51739fddb7b18b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.188+0000 7ff5637fe700 1 -- 172.21.15.112:0/2576663366 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580097b0 con 0x7ff5640c7a10 2020-11-20T11:43:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff5637fe700 1 -- 172.21.15.112:0/2576663366 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558000e90 con 0x7ff5640c7a10 2020-11-20T11:43:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff5637fe700 1 -- 172.21.15.112:0/2576663366 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558009b20 con 0x7ff5640c7a10 2020-11-20T11:43:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 -- 172.21.15.112:0/2576663366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c7a10 msgr2=0x7ff5640c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 --2- 172.21.15.112:0/2576663366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c7a10 0x7ff5640c7df0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff5640619c0 tx=0x7ff558006e30).stop 2020-11-20T11:43:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 -- 172.21.15.112:0/2576663366 shutdown_connections 2020-11-20T11:43:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 --2- 172.21.15.112:0/2576663366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c7a10 0x7ff5640c7df0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 --2- 172.21.15.112:0/2576663366 >> v2:172.21.15.166:3300/0 conn(0x7ff5640c4810 0x7ff5640c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 -- 172.21.15.112:0/2576663366 >> 172.21.15.112:0/2576663366 conn(0x7ff56405bac0 msgr2=0x7ff564062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 -- 172.21.15.112:0/2576663366 shutdown_connections 2020-11-20T11:43:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.189+0000 7ff569add700 1 -- 172.21.15.112:0/2576663366 wait complete. 2020-11-20T11:43:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.190+0000 7ff569add700 1 Processor -- start 2020-11-20T11:43:38.203 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.190+0000 7ff569add700 1 -- start start 2020-11-20T11:43:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5640601b0 0x7ff5641644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c4810 0x7ff56414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 0x7ff564149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564154970 con 0x7ff5640c7a10 2020-11-20T11:43:38.204 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564164990 con 0x7ff5640601b0 2020-11-20T11:43:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff569add700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564152750 con 0x7ff5640c4810 2020-11-20T11:43:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 0x7ff564149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.205 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 0x7ff564149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51512/0 (socket says 172.21.15.112:51512) 2020-11-20T11:43:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 -- 172.21.15.112:0/689206731 learned_addr learned my addr 172.21.15.112:0/689206731 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff568adb700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5640601b0 0x7ff5641644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff563fff700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c4810 0x7ff56414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 -- 172.21.15.112:0/689206731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c4810 msgr2=0x7ff56414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.207 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5640c4810 0x7ff56414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 -- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5640601b0 msgr2=0x7ff5641644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.208 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff5640601b0 0x7ff5641644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5641529f0 con 0x7ff5640c7a10 2020-11-20T11:43:38.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff5692dc700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 0x7ff564149a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff55c00ef50 tx=0x7ff55c009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.209 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cc30 con 0x7ff5640c7a10 2020-11-20T11:43:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.191+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00cd90 con 0x7ff5640c7a10 2020-11-20T11:43:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.192+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c012620 con 0x7ff5640c7a10 2020-11-20T11:43:38.210 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.192+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff564152c90 con 0x7ff5640c7a10 2020-11-20T11:43:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.192+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5641546d0 con 0x7ff5640c7a10 2020-11-20T11:43:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.192+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5640008d0 con 0x7ff5640c7a10 2020-11-20T11:43:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.193+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff55c022070 con 0x7ff5640c7a10 2020-11-20T11:43:38.217 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.193+0000 7ff560ff9700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff53c080670 0x7ff53c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff55c0a38c0 con 0x7ff5640c7a10 2020-11-20T11:43:38.218 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff560ff9700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7ff53c0893a0 0x7ff53c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff53c08be20 con 0x7ff53c0893a0 2020-11-20T11:43:38.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55c0a3c30 con 0x7ff5640c7a10 2020-11-20T11:43:38.219 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff568adb700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff53c080670 0x7ff53c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff563fff700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7ff53c0893a0 0x7ff53c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff568adb700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff53c080670 0x7ff53c082b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff558006e70 tx=0x7ff558015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.194+0000 7ff563fff700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7ff53c0893a0 0x7ff53c08b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.220 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.195+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== osd.1 v2:172.21.15.166:6802/22858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7ff53c08be20 con 0x7ff53c0893a0 2020-11-20T11:43:38.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.208+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 --> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff564160610 con 0x7ff53c0893a0 2020-11-20T11:43:38.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff560ff9700 1 -- 172.21.15.112:0/689206731 <== osd.1 v2:172.21.15.166:6802/22858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5500016b0 con 0x7ff53c0893a0 2020-11-20T11:43:38.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7ff53c0893a0 msgr2=0x7ff53c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6802/22858,v1:172.21.15.166:6803/22858] conn(0x7ff53c0893a0 0x7ff53c08b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff53c080670 msgr2=0x7ff53c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff53c080670 0x7ff53c082b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff558006e70 tx=0x7ff558015000).stop 2020-11-20T11:43:38.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 msgr2=0x7ff564149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 --2- 172.21.15.112:0/689206731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5640c7a10 0x7ff564149a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff55c00ef50 tx=0x7ff55c009220).stop 2020-11-20T11:43:38.222 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff5692dc700 1 -- 172.21.15.112:0/689206731 reap_dead start 2020-11-20T11:43:38.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 shutdown_connections 2020-11-20T11:43:38.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 >> 172.21.15.112:0/689206731 conn(0x7ff56405bac0 msgr2=0x7ff5640c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 shutdown_connections 2020-11-20T11:43:38.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.209+0000 7ff569add700 1 -- 172.21.15.112:0/689206731 wait complete. 2020-11-20T11:43:38.224 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:38.224 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:38.224 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:38.225 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T11:43:38.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.330+0000 7f4b8624f700 1 Processor -- start 2020-11-20T11:43:38.334 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.330+0000 7f4b8624f700 1 -- start start 2020-11-20T11:43:38.336 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.331+0000 7f4b8624f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b800c7a10 0x7f4b800c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.336 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.331+0000 7f4b8624f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b80060790 con 0x7f4b800c4810 2020-11-20T11:43:38.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.331+0000 7f4b8624f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b80060a30 con 0x7f4b800601b0 2020-11-20T11:43:38.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.331+0000 7f4b8624f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b800c4150 con 0x7f4b800c7a10 2020-11-20T11:43:38.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.331+0000 7f4b8524d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b800c7a10 0x7f4b800c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b85a4e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4b800c4810 0x7f4b801511d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35714/0 (socket says 172.21.15.112:35714) 2020-11-20T11:43:38.337 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b85a4e700 1 -- 172.21.15.112:0/2258388889 learned_addr learned my addr 172.21.15.112:0/2258388889 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:38.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8524d700 1 --2- 172.21.15.112:0/2258388889 >> v2:172.21.15.112:3300/0 conn(0x7f4b800c7a10 0x7f4b800c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51518/0 (socket says 172.21.15.112:51518) 2020-11-20T11:43:38.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8524d700 1 -- 172.21.15.112:0/2258388889 >> v1:172.21.15.166:6789/0 conn(0x7f4b800601b0 legacy=0x7f4b800bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8524d700 1 -- 172.21.15.112:0/2258388889 >> v1:172.21.15.112:6789/0 conn(0x7f4b800c4810 legacy=0x7f4b801511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.338 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8524d700 1 -- 172.21.15.112:0/2258388889 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80060cd0 con 0x7f4b800c7a10 2020-11-20T11:43:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b6ffff700 1 -- 172.21.15.112:0/2258388889 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427104614 0 0) 0x7f4b80060790 con 0x7f4b800c4810 2020-11-20T11:43:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8524d700 1 --2- 172.21.15.112:0/2258388889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c7a10 0x7f4b800c7df0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4b7c006fd0 tx=0x7f4b7c006e30).ready entity=mon.0 client_cookie=83462cecdb48540f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b6ffff700 1 -- 172.21.15.112:0/2258388889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0097e0 con 0x7f4b800c7a10 2020-11-20T11:43:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b6ffff700 1 -- 172.21.15.112:0/2258388889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c000e90 con 0x7f4b800c7a10 2020-11-20T11:43:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b6ffff700 1 -- 172.21.15.112:0/2258388889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c009b50 con 0x7f4b800c7a10 2020-11-20T11:43:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.332+0000 7f4b8624f700 1 -- 172.21.15.112:0/2258388889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c7a10 msgr2=0x7f4b800c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 --2- 172.21.15.112:0/2258388889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c7a10 0x7f4b800c7df0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4b7c006fd0 tx=0x7f4b7c006e30).stop 2020-11-20T11:43:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 -- 172.21.15.112:0/2258388889 shutdown_connections 2020-11-20T11:43:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 --2- 172.21.15.112:0/2258388889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c7a10 0x7f4b800c7df0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 -- 172.21.15.112:0/2258388889 >> 172.21.15.112:0/2258388889 conn(0x7f4b8005bac0 msgr2=0x7f4b80062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 -- 172.21.15.112:0/2258388889 shutdown_connections 2020-11-20T11:43:38.341 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.333+0000 7f4b8624f700 1 -- 172.21.15.112:0/2258388889 wait complete. 2020-11-20T11:43:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 Processor -- start 2020-11-20T11:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 -- start start 2020-11-20T11:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4b800601b0 0x7f4b80152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800c7a10 0x7f4b80155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80153580 con 0x7f4b800c4810 2020-11-20T11:43:38.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800bbd10 con 0x7f4b800601b0 2020-11-20T11:43:38.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b8624f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800bbfb0 con 0x7f4b800c7a10 2020-11-20T11:43:38.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.334+0000 7f4b84a4c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.345 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51526/0 (socket says 172.21.15.112:51526) 2020-11-20T11:43:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 -- 172.21.15.112:0/4157800566 learned_addr learned my addr 172.21.15.112:0/4157800566 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b8524d700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4b800601b0 0x7f4b80152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 -- 172.21.15.112:0/4157800566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800c7a10 msgr2=0x7f4b80155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b85a4e700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800c7a10 0x7f4b80155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.346 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800c7a10 0x7f4b80155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 -- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4b800601b0 msgr2=0x7f4b80152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4b800601b0 0x7f4b80152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 -- 172.21.15.112:0/4157800566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800bc250 con 0x7f4b800c4810 2020-11-20T11:43:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b84a4c700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4b7000c710 tx=0x7f4b70007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70007020 con 0x7f4b800c4810 2020-11-20T11:43:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70001e90 con 0x7f4b800c4810 2020-11-20T11:43:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700073b0 con 0x7f4b800c4810 2020-11-20T11:43:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800bc4f0 con 0x7f4b800c4810 2020-11-20T11:43:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.335+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8014e9c0 con 0x7f4b800c4810 2020-11-20T11:43:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.336+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b800008d0 con 0x7f4b800c4810 2020-11-20T11:43:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.337+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4b70010030 con 0x7f4b800c4810 2020-11-20T11:43:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.337+0000 7f4b6d7fa700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 0x7f4b58082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.337+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4b700a1ff0 con 0x7f4b800c4810 2020-11-20T11:43:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.337+0000 7f4b8524d700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 0x7f4b58082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.338+0000 7f4b8524d700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 0x7f4b58082b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4b7c00b150 tx=0x7f4b7c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.340+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4b70076a00 con 0x7f4b800c4810 2020-11-20T11:43:38.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.483+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b8014eca0 con 0x7f4b58080670 2020-11-20T11:43:38.487 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.484+0000 7f4b6d7fa700 1 -- 172.21.15.112:0/4157800566 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b8014eca0 con 0x7f4b58080670 2020-11-20T11:43:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.485+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 msgr2=0x7f4b58082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.485+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 0x7f4b58082b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4b7c00b150 tx=0x7f4b7c015000).stop 2020-11-20T11:43:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.485+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 msgr2=0x7f4b8014e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.485+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4b7000c710 tx=0x7f4b70007c60).stop 2020-11-20T11:43:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 shutdown_connections 2020-11-20T11:43:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4b58080670 0x7f4b58082b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b800c7a10 0x7f4b80155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4b800601b0 0x7f4b80152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 --2- 172.21.15.112:0/4157800566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b800c4810 0x7f4b8014e4d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 >> 172.21.15.112:0/4157800566 conn(0x7f4b8005bac0 msgr2=0x7f4b80151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 shutdown_connections 2020-11-20T11:43:38.492 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.486+0000 7f4b8624f700 1 -- 172.21.15.112:0/4157800566 wait complete. 2020-11-20T11:43:38.492 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T11:43:38.500 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T11:43:38.501 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:38.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.611+0000 7f1e4352b700 1 Processor -- start 2020-11-20T11:43:38.615 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.611+0000 7f1e4352b700 1 -- start start 2020-11-20T11:43:38.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e4352b700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1e3c1519f0 0x7f1e3c0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e4352b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0c5230 con 0x7f1e3c066110 2020-11-20T11:43:38.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e4352b700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c1549c0 con 0x7f1e3c065d30 2020-11-20T11:43:38.619 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e4352b700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0bff40 con 0x7f1e3c1519f0 2020-11-20T11:43:38.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e40ac6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1e3c066110 0x7f1e3c1512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35730/0 (socket says 172.21.15.112:35730) 2020-11-20T11:43:38.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e40ac6700 1 -- 172.21.15.112:0/2157290696 learned_addr learned my addr 172.21.15.112:0/2157290696 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:38.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.612+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> v2:172.21.15.204:3300/0 conn(0x7f1e3c1519f0 0x7f1e3c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837645031 0 0) 0x7f1e3c0c5230 con 0x7f1e3c066110 2020-11-20T11:43:38.620 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e24003280 con 0x7f1e3c066110 2020-11-20T11:43:38.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265037982 0 0) 0x7f1e3c1549c0 con 0x7f1e3c065d30 2020-11-20T11:43:38.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e3c0c5230 con 0x7f1e3c065d30 2020-11-20T11:43:38.621 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1086390266 0 0) 0x7f1e24003280 con 0x7f1e3c066110 2020-11-20T11:43:38.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 >> v2:172.21.15.204:3300/0 conn(0x7f1e3c1519f0 msgr2=0x7f1e3c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 --2- 172.21.15.112:0/2157290696 >> v2:172.21.15.204:3300/0 conn(0x7f1e3c1519f0 0x7f1e3c0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 >> v1:172.21.15.166:6789/0 conn(0x7f1e3c065d30 legacy=0x7f1e3c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c154c60 con 0x7f1e3c066110 2020-11-20T11:43:38.622 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f1e2c001520 con 0x7f1e3c066110 2020-11-20T11:43:38.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 >> v1:172.21.15.112:6789/0 conn(0x7f1e3c066110 legacy=0x7f1e3c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e240039a0 0x7f1e24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004520 0x7f1e240049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.623 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 0x7f1e2400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0bff40 con 0x7f1e24004e90 2020-11-20T11:43:38.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2400bc60 con 0x7f1e24004520 2020-11-20T11:43:38.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2400be20 con 0x7f1e240039a0 2020-11-20T11:43:38.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> v2:172.21.15.204:3300/0 conn(0x7f1e3c1519f0 0x7f1e3c0bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:38.624 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e412c7700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e240039a0 0x7f1e24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 0x7f1e2400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e40ac6700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004520 0x7f1e240049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 -- 172.21.15.112:0/2157290696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e240039a0 msgr2=0x7f1e24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e240039a0 0x7f1e24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.625 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 -- 172.21.15.112:0/2157290696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004520 msgr2=0x7f1e240049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004520 0x7f1e240049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e41ac8700 1 -- 172.21.15.112:0/2157290696 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24003280 con 0x7f1e24004e90 2020-11-20T11:43:38.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.613+0000 7f1e412c7700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e240039a0 0x7f1e24003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:38.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e41ac8700 1 -- 172.21.15.112:0/2157290696 reap_dead start 2020-11-20T11:43:38.626 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 0x7f1e2400b770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1e3400e320 tx=0x7f1e34009220).ready entity=mon.0 client_cookie=a38c86b4af9002a0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34009850 con 0x7f1e24004e90 2020-11-20T11:43:38.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400ee60 con 0x7f1e24004e90 2020-11-20T11:43:38.627 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e2bfff700 1 -- 172.21.15.112:0/2157290696 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34012600 con 0x7f1e24004e90 2020-11-20T11:43:38.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 -- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 msgr2=0x7f1e2400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 0x7f1e2400b770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1e3400e320 tx=0x7f1e34009220).stop 2020-11-20T11:43:38.628 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 -- 172.21.15.112:0/2157290696 shutdown_connections 2020-11-20T11:43:38.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 --2- 172.21.15.112:0/2157290696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e24004e90 0x7f1e2400b770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 -- 172.21.15.112:0/2157290696 >> 172.21.15.112:0/2157290696 conn(0x7f1e3c05bac0 msgr2=0x7f1e3c05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 -- 172.21.15.112:0/2157290696 shutdown_connections 2020-11-20T11:43:38.629 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.614+0000 7f1e4352b700 1 -- 172.21.15.112:0/2157290696 wait complete. 2020-11-20T11:43:38.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.615+0000 7f1e4352b700 1 Processor -- start 2020-11-20T11:43:38.630 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.615+0000 7f1e4352b700 1 -- start start 2020-11-20T11:43:38.634 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004e90 0x7f1e3c160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.634 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 0x7f1e3c1645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.634 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e3c0c06e0 0x7f1e3c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.634 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c69f0 con 0x7f1e3c14f620 2020-11-20T11:43:38.634 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c6c90 con 0x7f1e24004e90 2020-11-20T11:43:38.635 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e4352b700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c6f30 con 0x7f1e3c0c06e0 2020-11-20T11:43:38.635 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 0x7f1e3c1645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.635 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 0x7f1e3c1645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51546/0 (socket says 172.21.15.112:51546) 2020-11-20T11:43:38.635 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 -- 172.21.15.112:0/2590493106 learned_addr learned my addr 172.21.15.112:0/2590493106 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:38.635 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 -- 172.21.15.112:0/2590493106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e3c0c06e0 msgr2=0x7f1e3c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.636 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e3c0c06e0 0x7f1e3c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:43:38.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 -- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004e90 msgr2=0x7f1e3c160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f1e24004e90 0x7f1e3c160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:43:38.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.616+0000 7f1e40ac6700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0c71d0 con 0x7f1e3c14f620 2020-11-20T11:43:38.637 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e40ac6700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 0x7f1e3c1645c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f1e2c004b40 tx=0x7f1e3c154df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.638 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00f8d0 con 0x7f1e3c14f620 2020-11-20T11:43:38.638 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00fa30 con 0x7f1e3c14f620 2020-11-20T11:43:38.638 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00fdf0 con 0x7f1e3c14f620 2020-11-20T11:43:38.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c163e80 con 0x7f1e3c14f620 2020-11-20T11:43:38.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0c66b0 con 0x7f1e3c14f620 2020-11-20T11:43:38.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.617+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e3c0666e0 con 0x7f1e3c14f620 2020-11-20T11:43:38.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.618+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1e2c012560 con 0x7f1e3c14f620 2020-11-20T11:43:38.639 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e297fa700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1e140806a0 0x7f1e14082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1e2c0a22e0 con 0x7f1e3c14f620 2020-11-20T11:43:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e297fa700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7f1e140893d0 0x7f1e1408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e1408be50 con 0x7f1e140893d0 2020-11-20T11:43:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e2c0a2650 con 0x7f1e3c14f620 2020-11-20T11:43:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e412c7700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1e140806a0 0x7f1e14082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7f1e140893d0 0x7f1e1408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.619+0000 7f1e412c7700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1e140806a0 0x7f1e14082b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1e38007fd0 tx=0x7f1e38007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.620+0000 7f1e41ac8700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7f1e140893d0 0x7f1e1408b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.620+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== osd.4 v2:172.21.15.166:6821/22859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f1e1408be50 con 0x7f1e140893d0 2020-11-20T11:43:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.633+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 --> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1e3c1642e0 con 0x7f1e140893d0 2020-11-20T11:43:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e297fa700 1 -- 172.21.15.112:0/2590493106 <== osd.4 v2:172.21.15.166:6821/22859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1e3c1642e0 con 0x7f1e140893d0 2020-11-20T11:43:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7f1e140893d0 msgr2=0x7f1e1408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6821/22859,v1:172.21.15.166:6823/22859] conn(0x7f1e140893d0 0x7f1e1408b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1e140806a0 msgr2=0x7f1e14082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f1e140806a0 0x7f1e14082b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1e38007fd0 tx=0x7f1e38007bd0).stop 2020-11-20T11:43:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 msgr2=0x7f1e3c1645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 --2- 172.21.15.112:0/2590493106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e3c14f620 0x7f1e3c1645c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f1e2c004b40 tx=0x7f1e3c154df0).stop 2020-11-20T11:43:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e41ac8700 1 -- 172.21.15.112:0/2590493106 reap_dead start 2020-11-20T11:43:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 shutdown_connections 2020-11-20T11:43:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 >> 172.21.15.112:0/2590493106 conn(0x7f1e3c05bac0 msgr2=0x7f1e3c14e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 shutdown_connections 2020-11-20T11:43:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.634+0000 7f1e4352b700 1 -- 172.21.15.112:0/2590493106 wait complete. 2020-11-20T11:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:38.646 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:38.649 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T11:43:38.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.755+0000 7fe06e4d4700 1 Processor -- start 2020-11-20T11:43:38.759 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.755+0000 7fe06e4d4700 1 -- start start 2020-11-20T11:43:38.762 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06e4d4700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe068065d30 0x7fe068066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.762 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06e4d4700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fe0681512e0 0x7fe068151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06e4d4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0680c5230 con 0x7fe0680bfa50 2020-11-20T11:43:38.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06e4d4700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0681549c0 con 0x7fe0681512e0 2020-11-20T11:43:38.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06e4d4700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe068154c60 con 0x7fe068065d30 2020-11-20T11:43:38.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe0677fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe0680bfa50 0x7fe0680c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35752/0 (socket says 172.21.15.112:35752) 2020-11-20T11:43:38.763 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe0677fe700 1 -- 172.21.15.112:0/2787655784 learned_addr learned my addr 172.21.15.112:0/2787655784 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:38.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe067fff700 1 --2- 172.21.15.112:0/2787655784 >> v2:172.21.15.204:3300/0 conn(0x7fe068065d30 0x7fe068066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> v2:172.21.15.166:3300/0 conn(0x7fe0681512e0 0x7fe068151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427583526 0 0) 0x7fe0680c5230 con 0x7fe0680bfa50 2020-11-20T11:43:38.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.756+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe054003280 con 0x7fe0680bfa50 2020-11-20T11:43:38.764 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3777772616 0 0) 0x7fe054003280 con 0x7fe0680bfa50 2020-11-20T11:43:38.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 >> v2:172.21.15.204:3300/0 conn(0x7fe068065d30 msgr2=0x7fe068066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 --2- 172.21.15.112:0/2787655784 >> v2:172.21.15.204:3300/0 conn(0x7fe068065d30 0x7fe068066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 >> v2:172.21.15.166:3300/0 conn(0x7fe0681512e0 msgr2=0x7fe068151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 --2- 172.21.15.112:0/2787655784 >> v2:172.21.15.166:3300/0 conn(0x7fe0681512e0 0x7fe068151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.765 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068154f00 con 0x7fe0680bfa50 2020-11-20T11:43:38.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> v2:172.21.15.166:3300/0 conn(0x7fe0681512e0 0x7fe068151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:38.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7fe05c001520 con 0x7fe0680bfa50 2020-11-20T11:43:38.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 >> v1:172.21.15.112:6789/0 conn(0x7fe0680bfa50 legacy=0x7fe0680c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.766 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0540037c0 0x7fe054003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe054004520 0x7fe0540049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe05400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0681549c0 con 0x7fe054004e90 2020-11-20T11:43:38.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068154c60 con 0x7fe054004520 2020-11-20T11:43:38.767 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540053f0 con 0x7fe0540037c0 2020-11-20T11:43:38.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe05400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe0677fe700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe054004520 0x7fe0540049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe067fff700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0540037c0 0x7fe054003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 -- 172.21.15.112:0/2787655784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0540037c0 msgr2=0x7fe054003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.768 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0540037c0 0x7fe054003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 -- 172.21.15.112:0/2787655784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe054004520 msgr2=0x7fe0540049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe054004520 0x7fe0540049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 -- 172.21.15.112:0/2787655784 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054003280 con 0x7fe054004e90 2020-11-20T11:43:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.757+0000 7fe06ca71700 1 -- 172.21.15.112:0/2787655784 reap_dead start 2020-11-20T11:43:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06ca71700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe05400b770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe06000e350 tx=0x7fe060009220).ready entity=mon.0 client_cookie=965b243199e03094 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060009850 con 0x7fe054004e90 2020-11-20T11:43:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0600123f0 con 0x7fe054004e90 2020-11-20T11:43:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe066ffd700 1 -- 172.21.15.112:0/2787655784 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060012790 con 0x7fe054004e90 2020-11-20T11:43:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 -- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 msgr2=0x7fe05400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe05400b770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe06000e350 tx=0x7fe060009220).stop 2020-11-20T11:43:38.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 -- 172.21.15.112:0/2787655784 shutdown_connections 2020-11-20T11:43:38.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/2787655784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe05400b770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 -- 172.21.15.112:0/2787655784 >> 172.21.15.112:0/2787655784 conn(0x7fe06805bac0 msgr2=0x7fe06805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 -- 172.21.15.112:0/2787655784 shutdown_connections 2020-11-20T11:43:38.771 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.758+0000 7fe06e4d4700 1 -- 172.21.15.112:0/2787655784 wait complete. 2020-11-20T11:43:38.774 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.759+0000 7fe06e4d4700 1 Processor -- start 2020-11-20T11:43:38.774 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.760+0000 7fe06e4d4700 1 -- start start 2020-11-20T11:43:38.774 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0680c3470 0x7fe0680b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe06814d040 0x7fe068162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068161e80 con 0x7fe054004e90 2020-11-20T11:43:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068164e40 con 0x7fe06814d040 2020-11-20T11:43:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680b1cd0 con 0x7fe0680c3470 2020-11-20T11:43:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51566/0 (socket says 172.21.15.112:51566) 2020-11-20T11:43:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 -- 172.21.15.112:0/3278154006 learned_addr learned my addr 172.21.15.112:0/3278154006 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe0677fe700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0680c3470 0x7fe0680b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06ca71700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe06814d040 0x7fe068162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 -- 172.21.15.112:0/3278154006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0680c3470 msgr2=0x7fe0680b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0680c3470 0x7fe0680b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 -- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe06814d040 msgr2=0x7fe068162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe06814d040 0x7fe068162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 -- 172.21.15.112:0/3278154006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0681620b0 con 0x7fe054004e90 2020-11-20T11:43:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe067fff700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe058010a20 tx=0x7fe058008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05800e8d0 con 0x7fe054004e90 2020-11-20T11:43:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05800ea30 con 0x7fe054004e90 2020-11-20T11:43:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe068162350 con 0x7fe054004e90 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05800edb0 con 0x7fe054004e90 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.761+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe068162890 con 0x7fe054004e90 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.762+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe068065290 con 0x7fe054004e90 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.763+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe058014680 con 0x7fe054004e90 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.763+0000 7fe047fff700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 0x7fe040082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.764+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe0580a2e50 con 0x7fe054004e90 2020-11-20T11:43:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.764+0000 7fe0677fe700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 0x7fe040082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.764+0000 7fe0677fe700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 0x7fe040082b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe05c000fd0 tx=0x7fe05c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.767+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe058077860 con 0x7fe054004e90 2020-11-20T11:43:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.919+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe068162a90 con 0x7fe040080670 2020-11-20T11:43:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.919+0000 7fe047fff700 1 -- 172.21.15.112:0/3278154006 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe068162a90 con 0x7fe040080670 2020-11-20T11:43:38.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 msgr2=0x7fe040082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 0x7fe040082b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe05c000fd0 tx=0x7fe05c009040).stop 2020-11-20T11:43:38.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 msgr2=0x7fe068164950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:38.925 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe058010a20 tx=0x7fe058008040).stop 2020-11-20T11:43:38.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 shutdown_connections 2020-11-20T11:43:38.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe040080670 0x7fe040082b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe06814d040 0x7fe068162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe054004e90 0x7fe068164950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.926 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 --2- 172.21.15.112:0/3278154006 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0680c3470 0x7fe0680b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:38.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 >> 172.21.15.112:0/3278154006 conn(0x7fe06805bac0 msgr2=0x7fe06814e010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:38.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 shutdown_connections 2020-11-20T11:43:38.927 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:38.921+0000 7fe06e4d4700 1 -- 172.21.15.112:0/3278154006 wait complete. 2020-11-20T11:43:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T11:43:38.936 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T11:43:38.936 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:39.060 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.057+0000 7f6824cc0700 1 Processor -- start 2020-11-20T11:43:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.057+0000 7f6824cc0700 1 -- start start 2020-11-20T11:43:39.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f6824cc0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68200c5a10 0x7f68200c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.064 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f6824cc0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68201516b0 con 0x7f6820155700 2020-11-20T11:43:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f6824cc0700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6820155b60 con 0x7f6820061930 2020-11-20T11:43:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f6824cc0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68201518e0 con 0x7f68200c5a10 2020-11-20T11:43:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681e59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68200c5a10 0x7f68200c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681dd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6820155700 0x7f6820061220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35768/0 (socket says 172.21.15.112:35768) 2020-11-20T11:43:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681e59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68200c5a10 0x7f68200c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51574/0 (socket says 172.21.15.112:51574) 2020-11-20T11:43:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681dd9b700 1 -- 172.21.15.112:0/23787911 learned_addr learned my addr 172.21.15.112:0/23787911 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681e59c700 1 -- 172.21.15.112:0/23787911 >> v1:172.21.15.204:6789/0 conn(0x7f6820061930 legacy=0x7f6820064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681e59c700 1 -- 172.21.15.112:0/23787911 >> v1:172.21.15.112:6789/0 conn(0x7f6820155700 legacy=0x7f6820061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681d59a700 1 -- 172.21.15.112:0/23787911 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193405334 0 0) 0x7f6818001490 con 0x7f6820061930 2020-11-20T11:43:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.058+0000 7f681e59c700 1 -- 172.21.15.112:0/23787911 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820151b80 con 0x7f68200c5a10 2020-11-20T11:43:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f681e59c700 1 --2- 172.21.15.112:0/23787911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f68200c5df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f6810006fd0 tx=0x7f6810006e30).ready entity=mon.0 client_cookie=de17cad5dfaf9829 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f681d59a700 1 -- 172.21.15.112:0/23787911 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100096e0 con 0x7f68200c5a10 2020-11-20T11:43:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f681d59a700 1 -- 172.21.15.112:0/23787911 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6810000e90 con 0x7f68200c5a10 2020-11-20T11:43:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f681d59a700 1 -- 172.21.15.112:0/23787911 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6810009a50 con 0x7f68200c5a10 2020-11-20T11:43:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 -- 172.21.15.112:0/23787911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 msgr2=0x7f68200c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 --2- 172.21.15.112:0/23787911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f68200c5df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f6810006fd0 tx=0x7f6810006e30).stop 2020-11-20T11:43:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 -- 172.21.15.112:0/23787911 shutdown_connections 2020-11-20T11:43:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 --2- 172.21.15.112:0/23787911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f68200c5df0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 -- 172.21.15.112:0/23787911 >> 172.21.15.112:0/23787911 conn(0x7f68200bbc50 msgr2=0x7f68200bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 -- 172.21.15.112:0/23787911 shutdown_connections 2020-11-20T11:43:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.059+0000 7f6824cc0700 1 -- 172.21.15.112:0/23787911 wait complete. 2020-11-20T11:43:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 Processor -- start 2020-11-20T11:43:39.070 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 -- start start 2020-11-20T11:43:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6820061930 0x7f68200c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f6820160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6820155700 0x7f6820164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200bcac0 con 0x7f68200c5a10 2020-11-20T11:43:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200bcd60 con 0x7f6820155700 2020-11-20T11:43:39.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f6824cc0700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820164310 con 0x7f6820061930 2020-11-20T11:43:39.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f681dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f6820160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f681dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f6820160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51582/0 (socket says 172.21.15.112:51582) 2020-11-20T11:43:39.074 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f681dd9b700 1 -- 172.21.15.112:0/4055921891 learned_addr learned my addr 172.21.15.112:0/4055921891 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.061+0000 7f681e59c700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6820061930 0x7f68200c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681ed9d700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6820155700 0x7f6820164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 -- 172.21.15.112:0/4055921891 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6820061930 msgr2=0x7f68200c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6820061930 0x7f68200c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.075 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 -- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6820155700 msgr2=0x7f6820164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6820155700 0x7f6820164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68201645b0 con 0x7f68200c5a10 2020-11-20T11:43:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f681dd9b700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f6820160d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f681400c7d0 tx=0x7f6814007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814007320 con 0x7f68200c5a10 2020-11-20T11:43:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814007480 con 0x7f68200c5a10 2020-11-20T11:43:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200bd000 con 0x7f68200c5a10 2020-11-20T11:43:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814005840 con 0x7f68200c5a10 2020-11-20T11:43:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.062+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6820164f40 con 0x7f68200c5a10 2020-11-20T11:43:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.063+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6820069be0 con 0x7f68200c5a10 2020-11-20T11:43:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.064+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6814010030 con 0x7f68200c5a10 2020-11-20T11:43:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.064+0000 7f680e7fc700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f67f40806a0 0x7f67f4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f68140a2f70 con 0x7f68200c5a10 2020-11-20T11:43:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f680e7fc700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7f67f40893d0 0x7f67f408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67f408be50 con 0x7f67f40893d0 2020-11-20T11:43:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68140a32e0 con 0x7f68200c5a10 2020-11-20T11:43:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f681e59c700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f67f40806a0 0x7f67f4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f681ed9d700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7f67f40893d0 0x7f67f408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f681e59c700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f67f40806a0 0x7f67f4082b60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6810006bc0 tx=0x7f6810015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.065+0000 7f681ed9d700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7f67f40893d0 0x7f67f408b7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.080 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.066+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== osd.7 v2:172.21.15.166:6810/22860 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f67f408be50 con 0x7f67f40893d0 2020-11-20T11:43:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.080+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 --> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68200bf8a0 con 0x7f67f40893d0 2020-11-20T11:43:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.080+0000 7f680e7fc700 1 -- 172.21.15.112:0/4055921891 <== osd.7 v2:172.21.15.166:6810/22860 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f68200bf8a0 con 0x7f67f40893d0 2020-11-20T11:43:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.080+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7f67f40893d0 msgr2=0x7f67f408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.080+0000 7f6824cc0700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6810/22860,v1:172.21.15.166:6811/22860] conn(0x7f67f40893d0 0x7f67f408b7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f67f40806a0 msgr2=0x7f67f4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f67f40806a0 0x7f67f4082b60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6810006bc0 tx=0x7f6810015000).stop 2020-11-20T11:43:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 msgr2=0x7f6820160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 --2- 172.21.15.112:0/4055921891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68200c5a10 0x7f6820160d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f681400c7d0 tx=0x7f6814007c10).stop 2020-11-20T11:43:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f681ed9d700 1 -- 172.21.15.112:0/4055921891 reap_dead start 2020-11-20T11:43:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 shutdown_connections 2020-11-20T11:43:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 >> 172.21.15.112:0/4055921891 conn(0x7f68200bbc50 msgr2=0x7f68200bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 shutdown_connections 2020-11-20T11:43:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.081+0000 7f6824cc0700 1 -- 172.21.15.112:0/4055921891 wait complete. 2020-11-20T11:43:39.088 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:39.088 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:39.088 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:39.096 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T11:43:39.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.217+0000 7fe05e8a1700 1 Processor -- start 2020-11-20T11:43:39.221 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.217+0000 7fe05e8a1700 1 -- start start 2020-11-20T11:43:39.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe05e8a1700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0581519f0 0x7fe0580bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.223 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe05e8a1700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580c5230 con 0x7fe058066110 2020-11-20T11:43:39.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe05e8a1700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0581549c0 con 0x7fe058065d30 2020-11-20T11:43:39.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe05e8a1700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0580bff40 con 0x7fe0581519f0 2020-11-20T11:43:39.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe057fff700 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe058065d30 0x7fe0580c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.112:45912/0 (socket says 172.21.15.112:45912) 2020-11-20T11:43:39.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe057fff700 1 -- 172.21.15.112:0/491358984 learned_addr learned my addr 172.21.15.112:0/491358984 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:39.224 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe05ce3e700 1 --2- 172.21.15.112:0/491358984 >> v2:172.21.15.204:3300/0 conn(0x7fe0581519f0 0x7fe0580bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748362222 0 0) 0x7fe0581549c0 con 0x7fe058065d30 2020-11-20T11:43:39.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.218+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe038003280 con 0x7fe058065d30 2020-11-20T11:43:39.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251052664 0 0) 0x7fe0580c5230 con 0x7fe058066110 2020-11-20T11:43:39.225 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0581549c0 con 0x7fe058066110 2020-11-20T11:43:39.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05ce3e700 1 -- 172.21.15.112:0/491358984 >> v1:172.21.15.204:6789/0 conn(0x7fe058065d30 legacy=0x7fe0580c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05ce3e700 1 -- 172.21.15.112:0/491358984 >> v1:172.21.15.166:6789/0 conn(0x7fe058066110 legacy=0x7fe0581512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05ce3e700 1 -- 172.21.15.112:0/491358984 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058154c60 con 0x7fe0581519f0 2020-11-20T11:43:39.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05ce3e700 1 --2- 172.21.15.112:0/491358984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0581519f0 0x7fe0580bfa50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe050009ce0 tx=0x7fe050009220).ready entity=mon.2 client_cookie=1907ec0e4a160305 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.226 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000b990 con 0x7fe0581519f0 2020-11-20T11:43:39.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000baf0 con 0x7fe0581519f0 2020-11-20T11:43:39.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe0577fe700 1 -- 172.21.15.112:0/491358984 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000be70 con 0x7fe0581519f0 2020-11-20T11:43:39.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 -- 172.21.15.112:0/491358984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0581519f0 msgr2=0x7fe0580bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/491358984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0581519f0 0x7fe0580bfa50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe050009ce0 tx=0x7fe050009220).stop 2020-11-20T11:43:39.227 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 -- 172.21.15.112:0/491358984 shutdown_connections 2020-11-20T11:43:39.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/491358984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0581519f0 0x7fe0580bfa50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 -- 172.21.15.112:0/491358984 >> 172.21.15.112:0/491358984 conn(0x7fe05805bac0 msgr2=0x7fe05805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 -- 172.21.15.112:0/491358984 shutdown_connections 2020-11-20T11:43:39.228 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.219+0000 7fe05e8a1700 1 -- 172.21.15.112:0/491358984 wait complete. 2020-11-20T11:43:39.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.220+0000 7fe05e8a1700 1 Processor -- start 2020-11-20T11:43:39.231 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 -- start start 2020-11-20T11:43:39.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 0x7fe05814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe058066110 0x7fe0580c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580be340 con 0x7fe0581519f0 2020-11-20T11:43:39.232 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05814dca0 con 0x7fe058065d30 2020-11-20T11:43:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05e8a1700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe058163c10 con 0x7fe058066110 2020-11-20T11:43:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05ce3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05ce3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51600/0 (socket says 172.21.15.112:51600) 2020-11-20T11:43:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe05ce3e700 1 -- 172.21.15.112:0/1196913277 learned_addr learned my addr 172.21.15.112:0/1196913277 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.221+0000 7fe057fff700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 0x7fe05814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe04ffff700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe058066110 0x7fe0580c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 -- 172.21.15.112:0/1196913277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe058066110 msgr2=0x7fe0580c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe058066110 0x7fe0580c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.236 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 -- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 msgr2=0x7fe05814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 0x7fe05814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 -- 172.21.15.112:0/1196913277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058163eb0 con 0x7fe0581519f0 2020-11-20T11:43:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe057fff700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 0x7fe05814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:43:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05ce3e700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe050006f90 tx=0x7fe050016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050010800 con 0x7fe0581519f0 2020-11-20T11:43:39.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe050010960 con 0x7fe0581519f0 2020-11-20T11:43:39.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058164150 con 0x7fe0581519f0 2020-11-20T11:43:39.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050010ce0 con 0x7fe0581519f0 2020-11-20T11:43:39.238 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.222+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe058164930 con 0x7fe0581519f0 2020-11-20T11:43:39.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.223+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe058065740 con 0x7fe0581519f0 2020-11-20T11:43:39.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.224+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe050017070 con 0x7fe0581519f0 2020-11-20T11:43:39.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.224+0000 7fe054ff9700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 0x7fe034082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.224+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe0500a4ee0 con 0x7fe0581519f0 2020-11-20T11:43:39.239 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.224+0000 7fe057fff700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 0x7fe034082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.225+0000 7fe057fff700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 0x7fe034082b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe0480055e0 tx=0x7fe048009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.227+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe0500798f0 con 0x7fe0581519f0 2020-11-20T11:43:39.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.367+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0580666c0 con 0x7fe034080670 2020-11-20T11:43:39.371 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.368+0000 7fe054ff9700 1 -- 172.21.15.112:0/1196913277 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0580666c0 con 0x7fe034080670 2020-11-20T11:43:39.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 msgr2=0x7fe034082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 0x7fe034082b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe0480055e0 tx=0x7fe048009040).stop 2020-11-20T11:43:39.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 msgr2=0x7fe0580b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.373 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe050006f90 tx=0x7fe050016000).stop 2020-11-20T11:43:39.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 shutdown_connections 2020-11-20T11:43:39.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fe034080670 0x7fe034082b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0581519f0 0x7fe0580b0b20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fe058065d30 0x7fe05814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.374 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 --2- 172.21.15.112:0/1196913277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe058066110 0x7fe0580c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 >> 172.21.15.112:0/1196913277 conn(0x7fe05805bac0 msgr2=0x7fe0580c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 shutdown_connections 2020-11-20T11:43:39.375 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.369+0000 7fe05e8a1700 1 -- 172.21.15.112:0/1196913277 wait complete. 2020-11-20T11:43:39.376 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T11:43:39.385 INFO:tasks.ceph:Scrubbing osd.10 2020-11-20T11:43:39.385 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.502+0000 7f6288f4f700 1 Processor -- start 2020-11-20T11:43:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.502+0000 7f6288f4f700 1 -- start start 2020-11-20T11:43:39.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6288f4f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6284066110 0x7f62840bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.508 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6288f4f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840c5230 con 0x7f6284065d30 2020-11-20T11:43:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6288f4f700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62841549c0 con 0x7f62841512e0 2020-11-20T11:43:39.511 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6288f4f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840bff40 con 0x7f6284066110 2020-11-20T11:43:39.523 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6281d9b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6284066110 0x7f62840bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6281d9b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f6284066110 0x7f62840bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.112:39602/0 (socket says 172.21.15.112:39602) 2020-11-20T11:43:39.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.503+0000 7f6281d9b700 1 -- 172.21.15.112:0/302774378 learned_addr learned my addr 172.21.15.112:0/302774378 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6281d9b700 1 -- 172.21.15.112:0/302774378 >> v1:172.21.15.204:6789/0 conn(0x7f62841512e0 legacy=0x7f6284151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.525 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6281d9b700 1 -- 172.21.15.112:0/302774378 >> v1:172.21.15.166:6789/0 conn(0x7f6284065d30 legacy=0x7f62840c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f628159a700 1 -- 172.21.15.112:0/302774378 <== mon.2 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815039132 0 0) 0x7f62841549c0 con 0x7f62841512e0 2020-11-20T11:43:39.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6281d9b700 1 -- 172.21.15.112:0/302774378 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284154c60 con 0x7f6284066110 2020-11-20T11:43:39.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6281d9b700 1 --2- 172.21.15.112:0/302774378 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284066110 0x7f62840bfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6278009a10 tx=0x7f6278006ef0).ready entity=mon.1 client_cookie=a926068eda5b8b62 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.526 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f628159a700 1 -- 172.21.15.112:0/302774378 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800b760 con 0x7f6284066110 2020-11-20T11:43:39.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f628159a700 1 -- 172.21.15.112:0/302774378 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278000e90 con 0x7f6284066110 2020-11-20T11:43:39.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f628159a700 1 -- 172.21.15.112:0/302774378 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bad0 con 0x7f6284066110 2020-11-20T11:43:39.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 -- 172.21.15.112:0/302774378 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284066110 msgr2=0x7f62840bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 --2- 172.21.15.112:0/302774378 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284066110 0x7f62840bfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6278009a10 tx=0x7f6278006ef0).stop 2020-11-20T11:43:39.527 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 -- 172.21.15.112:0/302774378 shutdown_connections 2020-11-20T11:43:39.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 --2- 172.21.15.112:0/302774378 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284066110 0x7f62840bfa50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 -- 172.21.15.112:0/302774378 >> 172.21.15.112:0/302774378 conn(0x7f628405bac0 msgr2=0x7f628405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 -- 172.21.15.112:0/302774378 shutdown_connections 2020-11-20T11:43:39.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.504+0000 7f6288f4f700 1 -- 172.21.15.112:0/302774378 wait complete. 2020-11-20T11:43:39.528 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.505+0000 7f6288f4f700 1 Processor -- start 2020-11-20T11:43:39.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 -- start start 2020-11-20T11:43:39.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284065d30 0x7f62840b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 0x7f6284164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.529 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62841512e0 0x7f62841605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b2720 con 0x7f6284066110 2020-11-20T11:43:39.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b29c0 con 0x7f6284065d30 2020-11-20T11:43:39.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6288f4f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b2c60 con 0x7f62841512e0 2020-11-20T11:43:39.530 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6281d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 0x7f6284164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6281d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 0x7f6284164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51612/0 (socket says 172.21.15.112:51612) 2020-11-20T11:43:39.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.506+0000 7f6281d9b700 1 -- 172.21.15.112:0/4144386047 learned_addr learned my addr 172.21.15.112:0/4144386047 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6282d9d700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62841512e0 0x7f62841605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f628259c700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284065d30 0x7f62840b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.531 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 -- 172.21.15.112:0/4144386047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62841512e0 msgr2=0x7f62841605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62841512e0 0x7f62841605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 -- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284065d30 msgr2=0x7f62840b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6284065d30 0x7f62840b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284163c40 con 0x7f6284066110 2020-11-20T11:43:39.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6281d9b700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 0x7f6284164620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f62840c01a0 tx=0x7f6278015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780067a0 con 0x7f6284066110 2020-11-20T11:43:39.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278011c10 con 0x7f6284066110 2020-11-20T11:43:39.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6284163ee0 con 0x7f6284066110 2020-11-20T11:43:39.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627801d450 con 0x7f6284066110 2020-11-20T11:43:39.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.507+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6284156380 con 0x7f6284066110 2020-11-20T11:43:39.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.508+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62840666e0 con 0x7f6284066110 2020-11-20T11:43:39.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f627800f070 con 0x7f6284066110 2020-11-20T11:43:39.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6258080670 0x7f6258082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f62780a4fe0 con 0x7f6284066110 2020-11-20T11:43:39.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7f6258089320 0x7f625808b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f625808bda0 con 0x7f6258089320 2020-11-20T11:43:39.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62780a53e0 con 0x7f6284066110 2020-11-20T11:43:39.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f628259c700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6258080670 0x7f6258082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.509+0000 7f6282d9d700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7f6258089320 0x7f625808b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.510+0000 7f628259c700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6258080670 0x7f6258082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6274007fd0 tx=0x7f6274007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.510+0000 7f6282d9d700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7f6258089320 0x7f625808b740 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.513+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== osd.10 v2:172.21.15.166:6818/22861 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f625808bda0 con 0x7f6258089320 2020-11-20T11:43:39.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.526+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 --> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6284065740 con 0x7f6258089320 2020-11-20T11:43:39.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f62727fc700 1 -- 172.21.15.112:0/4144386047 <== osd.10 v2:172.21.15.166:6818/22861 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6284065740 con 0x7f6258089320 2020-11-20T11:43:39.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7f6258089320 msgr2=0x7f625808b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6818/22861,v1:172.21.15.166:6819/22861] conn(0x7f6258089320 0x7f625808b740 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6258080670 msgr2=0x7f6258082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f6258080670 0x7f6258082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6274007fd0 tx=0x7f6274007bd0).stop 2020-11-20T11:43:39.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 msgr2=0x7f6284164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 --2- 172.21.15.112:0/4144386047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6284066110 0x7f6284164620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f62840c01a0 tx=0x7f6278015000).stop 2020-11-20T11:43:39.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6282d9d700 1 -- 172.21.15.112:0/4144386047 reap_dead start 2020-11-20T11:43:39.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 shutdown_connections 2020-11-20T11:43:39.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 >> 172.21.15.112:0/4144386047 conn(0x7f628405bac0 msgr2=0x7f628405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 shutdown_connections 2020-11-20T11:43:39.548 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.527+0000 7f6288f4f700 1 -- 172.21.15.112:0/4144386047 wait complete. 2020-11-20T11:43:39.548 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:39.548 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:39.548 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:39.549 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2020-11-20T11:43:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.659+0000 7f3ae22c4700 1 Processor -- start 2020-11-20T11:43:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.659+0000 7f3ae22c4700 1 -- start start 2020-11-20T11:43:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae22c4700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f3adc066110 0x7f3adc0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae22c4700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3adc1512e0 0x7f3adc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae22c4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc0c5230 con 0x7f3adc065d30 2020-11-20T11:43:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae22c4700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc0bff40 con 0x7f3adc066110 2020-11-20T11:43:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae22c4700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc1549c0 con 0x7f3adc1512e0 2020-11-20T11:43:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3adbfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3adc065d30 0x7f3adc0c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35814/0 (socket says 172.21.15.112:35814) 2020-11-20T11:43:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3adbfff700 1 -- 172.21.15.112:0/3427968568 learned_addr learned my addr 172.21.15.112:0/3427968568 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/3427968568 >> v2:172.21.15.166:3300/0 conn(0x7f3adc066110 0x7f3adc0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3ae0861700 1 --2- 172.21.15.112:0/3427968568 >> v2:172.21.15.204:3300/0 conn(0x7f3adc1512e0 0x7f3adc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408545724 0 0) 0x7f3adc0c5230 con 0x7f3adc065d30 2020-11-20T11:43:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.660+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac8003280 con 0x7f3adc065d30 2020-11-20T11:43:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adb7fe700 1 -- 172.21.15.112:0/3427968568 >> v2:172.21.15.204:3300/0 conn(0x7f3adc1512e0 msgr2=0x7f3adc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1595522633 0 0) 0x7f3ac8003280 con 0x7f3adc065d30 2020-11-20T11:43:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/3427968568 >> v2:172.21.15.204:3300/0 conn(0x7f3adc1512e0 0x7f3adc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adb7fe700 1 -- 172.21.15.112:0/3427968568 >> v1:172.21.15.112:6789/0 conn(0x7f3adc065d30 legacy=0x7f3adc0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adb7fe700 1 -- 172.21.15.112:0/3427968568 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc154c60 con 0x7f3adc066110 2020-11-20T11:43:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/3427968568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc066110 0x7f3adc0bfa50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3adc1548b0 tx=0x7f3ad0006e30).ready entity=mon.1 client_cookie=8e496b953348b590 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc001520 con 0x7f3adc066110 2020-11-20T11:43:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0000e90 con 0x7f3adc066110 2020-11-20T11:43:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3adaffd700 1 -- 172.21.15.112:0/3427968568 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0011610 con 0x7f3adc066110 2020-11-20T11:43:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 -- 172.21.15.112:0/3427968568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc066110 msgr2=0x7f3adc0bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/3427968568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc066110 0x7f3adc0bfa50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3adc1548b0 tx=0x7f3ad0006e30).stop 2020-11-20T11:43:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 -- 172.21.15.112:0/3427968568 shutdown_connections 2020-11-20T11:43:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/3427968568 >> v2:172.21.15.204:3300/0 conn(0x7f3adc1512e0 0x7f3adc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/3427968568 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc066110 0x7f3adc0bfa50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 -- 172.21.15.112:0/3427968568 >> 172.21.15.112:0/3427968568 conn(0x7f3adc05bac0 msgr2=0x7f3adc05bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.661+0000 7f3ae22c4700 1 -- 172.21.15.112:0/3427968568 shutdown_connections 2020-11-20T11:43:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.662+0000 7f3ae22c4700 1 -- 172.21.15.112:0/3427968568 wait complete. 2020-11-20T11:43:39.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 Processor -- start 2020-11-20T11:43:39.676 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 -- start start 2020-11-20T11:43:39.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3adc065d30 0x7f3adc0c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc1512e0 0x7f3adc0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.677 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0b2ab0 con 0x7f3adc066110 2020-11-20T11:43:39.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc160760 con 0x7f3adc1512e0 2020-11-20T11:43:39.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3ae22c4700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc164000 con 0x7f3adc065d30 2020-11-20T11:43:39.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3adb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3adb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51628/0 (socket says 172.21.15.112:51628) 2020-11-20T11:43:39.678 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.663+0000 7f3adb7fe700 1 -- 172.21.15.112:0/4118017195 learned_addr learned my addr 172.21.15.112:0/4118017195 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adbfff700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3adc065d30 0x7f3adc0c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3ae0861700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc1512e0 0x7f3adc0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.679 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 -- 172.21.15.112:0/4118017195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3adc065d30 msgr2=0x7f3adc0c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3adc065d30 0x7f3adc0c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 -- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc1512e0 msgr2=0x7f3adc0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc1512e0 0x7f3adc0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 -- 172.21.15.112:0/4118017195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc1642a0 con 0x7f3adc066110 2020-11-20T11:43:39.680 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3adb7fe700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3adc05d740 tx=0x7f3ad0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0010af0 con 0x7f3adc066110 2020-11-20T11:43:39.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0010c50 con 0x7f3adc066110 2020-11-20T11:43:39.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc164540 con 0x7f3adc066110 2020-11-20T11:43:39.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad001e460 con 0x7f3adc066110 2020-11-20T11:43:39.681 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.664+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc164a80 con 0x7f3adc066110 2020-11-20T11:43:39.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.665+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc065740 con 0x7f3adc066110 2020-11-20T11:43:39.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.665+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3ad0025030 con 0x7f3adc066110 2020-11-20T11:43:39.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.666+0000 7f3abbfff700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 0x7f3ab4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.666+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3ad00a3ba0 con 0x7f3adc066110 2020-11-20T11:43:39.682 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.666+0000 7f3adbfff700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 0x7f3ab4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.666+0000 7f3adbfff700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 0x7f3ab4082b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f3acc000c00 tx=0x7f3acc001e50).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.683 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.669+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3ad00785b0 con 0x7f3adc066110 2020-11-20T11:43:39.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.813+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7f3adc0666c0 con 0x7f3ab4080670 2020-11-20T11:43:39.817 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.813+0000 7f3abbfff700 1 -- 172.21.15.112:0/4118017195 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f3adc0666c0 con 0x7f3ab4080670 2020-11-20T11:43:39.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 msgr2=0x7f3ab4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 0x7f3ab4082b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f3acc000c00 tx=0x7f3acc001e50).stop 2020-11-20T11:43:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 msgr2=0x7f3adc0b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3adc05d740 tx=0x7f3ad0015000).stop 2020-11-20T11:43:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 shutdown_connections 2020-11-20T11:43:39.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f3ab4080670 0x7f3ab4082b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3adc1512e0 0x7f3adc0b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3adc065d30 0x7f3adc0c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 --2- 172.21.15.112:0/4118017195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc066110 0x7f3adc0b1f00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 >> 172.21.15.112:0/4118017195 conn(0x7f3adc05bac0 msgr2=0x7f3adc0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 shutdown_connections 2020-11-20T11:43:39.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.815+0000 7f3ae22c4700 1 -- 172.21.15.112:0/4118017195 wait complete. 2020-11-20T11:43:39.825 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 10 to deep-scrub 2020-11-20T11:43:39.831 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T11:43:39.831 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:39.948 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 Processor -- start 2020-11-20T11:43:39.949 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 -- start start 2020-11-20T11:43:39.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f493414eaf0 0x7f49340bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4934060c20 0x7f49340bade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.961 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4934151370 con 0x7f49340bdb80 2020-11-20T11:43:39.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4934152220 con 0x7f493414eaf0 2020-11-20T11:43:39.962 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.945+0000 7f4939b50700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4934155640 con 0x7f4934060c20 2020-11-20T11:43:39.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49337fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49340bdb80 0x7f493414e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35828/0 (socket says 172.21.15.112:35828) 2020-11-20T11:43:39.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49337fe700 1 -- 172.21.15.112:0/3151818393 learned_addr learned my addr 172.21.15.112:0/3151818393 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 --2- 172.21.15.112:0/3151818393 >> v2:172.21.15.204:3300/0 conn(0x7f4934060c20 0x7f49340bade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4932ffd700 1 --2- 172.21.15.112:0/3151818393 >> v2:172.21.15.166:3300/0 conn(0x7f493414eaf0 0x7f49340bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49327fc700 1 -- 172.21.15.112:0/3151818393 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601863664 0 0) 0x7f4934151370 con 0x7f49340bdb80 2020-11-20T11:43:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49327fc700 1 -- 172.21.15.112:0/3151818393 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920003280 con 0x7f49340bdb80 2020-11-20T11:43:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 -- 172.21.15.112:0/3151818393 >> v2:172.21.15.166:3300/0 conn(0x7f493414eaf0 msgr2=0x7f49340bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 --2- 172.21.15.112:0/3151818393 >> v2:172.21.15.166:3300/0 conn(0x7f493414eaf0 0x7f49340bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 -- 172.21.15.112:0/3151818393 >> v1:172.21.15.112:6789/0 conn(0x7f49340bdb80 legacy=0x7f493414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 -- 172.21.15.112:0/3151818393 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49341515a0 con 0x7f4934060c20 2020-11-20T11:43:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f4933fff700 1 --2- 172.21.15.112:0/3151818393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4934060c20 0x7f49340bade0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f49340c3ee0 tx=0x7f492c009220).ready entity=mon.2 client_cookie=1aad31bfd685fe84 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49327fc700 1 -- 172.21.15.112:0/3151818393 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00ba00 con 0x7f4934060c20 2020-11-20T11:43:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49327fc700 1 -- 172.21.15.112:0/3151818393 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00bb60 con 0x7f4934060c20 2020-11-20T11:43:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.946+0000 7f49327fc700 1 -- 172.21.15.112:0/3151818393 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011400 con 0x7f4934060c20 2020-11-20T11:43:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 -- 172.21.15.112:0/3151818393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4934060c20 msgr2=0x7f49340bade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 --2- 172.21.15.112:0/3151818393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4934060c20 0x7f49340bade0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f49340c3ee0 tx=0x7f492c009220).stop 2020-11-20T11:43:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 -- 172.21.15.112:0/3151818393 shutdown_connections 2020-11-20T11:43:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 --2- 172.21.15.112:0/3151818393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4934060c20 0x7f49340bade0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 --2- 172.21.15.112:0/3151818393 >> v2:172.21.15.166:3300/0 conn(0x7f493414eaf0 0x7f49340bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 -- 172.21.15.112:0/3151818393 >> 172.21.15.112:0/3151818393 conn(0x7f493405bac0 msgr2=0x7f49340669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 -- 172.21.15.112:0/3151818393 shutdown_connections 2020-11-20T11:43:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.947+0000 7f4939b50700 1 -- 172.21.15.112:0/3151818393 wait complete. 2020-11-20T11:43:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.948+0000 7f4939b50700 1 Processor -- start 2020-11-20T11:43:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.948+0000 7f4939b50700 1 -- start start 2020-11-20T11:43:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4934060c20 0x7f49341575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 0x7f4934161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f493414eaf0 0x7f49341536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934157da0 con 0x7f49340bdb80 2020-11-20T11:43:39.970 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49341148a0 con 0x7f4934060c20 2020-11-20T11:43:39.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934114b40 con 0x7f493414eaf0 2020-11-20T11:43:39.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 0x7f4934161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 0x7f4934161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51642/0 (socket says 172.21.15.112:51642) 2020-11-20T11:43:39.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 -- 172.21.15.112:0/163597230 learned_addr learned my addr 172.21.15.112:0/163597230 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:39.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4933fff700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f493414eaf0 0x7f49341536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f49337fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4934060c20 0x7f49341575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 -- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f493414eaf0 msgr2=0x7f49341536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f493414eaf0 0x7f49341536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 -- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4934060c20 msgr2=0x7f49341575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4934060c20 0x7f49341575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934114de0 con 0x7f49340bdb80 2020-11-20T11:43:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f49337fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4934060c20 0x7f49341575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4933fff700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f493414eaf0 0x7f49341536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4932ffd700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 0x7f4934161050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f492800d930 tx=0x7f4928008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800de70 con 0x7f49340bdb80 2020-11-20T11:43:39.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928009850 con 0x7f49340bdb80 2020-11-20T11:43:39.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4934160670 con 0x7f49340bdb80 2020-11-20T11:43:39.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928009c10 con 0x7f49340bdb80 2020-11-20T11:43:39.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.949+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4934160bb0 con 0x7f49340bdb80 2020-11-20T11:43:39.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.950+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49340666e0 con 0x7f49340bdb80 2020-11-20T11:43:39.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4928013480 con 0x7f49340bdb80 2020-11-20T11:43:39.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f490c080670 0x7f490c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f49280a3770 con 0x7f49340bdb80 2020-11-20T11:43:39.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f490c089420 0x7f490c08b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:39.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f490c08bea0 con 0x7f490c089420 2020-11-20T11:43:39.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.951+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49280a3aa0 con 0x7f49340bdb80 2020-11-20T11:43:39.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.952+0000 7f49337fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f490c080670 0x7f490c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.952+0000 7f4933fff700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f490c089420 0x7f490c08b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:39.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.952+0000 7f49337fe700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f490c080670 0x7f490c082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f49240055e0 tx=0x7f4924009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.952+0000 7f4933fff700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f490c089420 0x7f490c08b840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:39.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.953+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== osd.2 v2:172.21.15.204:6800/23308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f490c08bea0 con 0x7f490c089420 2020-11-20T11:43:39.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.966+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 --> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4934061e70 con 0x7f490c089420 2020-11-20T11:43:39.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.967+0000 7f49137fe700 1 -- 172.21.15.112:0/163597230 <== osd.2 v2:172.21.15.204:6800/23308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4934061e70 con 0x7f490c089420 2020-11-20T11:43:39.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.967+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f490c089420 msgr2=0x7f490c08b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.967+0000 7f4939b50700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.204:6800/23308,v1:172.21.15.204:6801/23308] conn(0x7f490c089420 0x7f490c08b840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:39.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f490c080670 msgr2=0x7f490c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f490c080670 0x7f490c082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f49240055e0 tx=0x7f4924009040).stop 2020-11-20T11:43:39.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 msgr2=0x7f4934161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:39.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 --2- 172.21.15.112:0/163597230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340bdb80 0x7f4934161050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f492800d930 tx=0x7f4928008040).stop 2020-11-20T11:43:39.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4933fff700 1 -- 172.21.15.112:0/163597230 reap_dead start 2020-11-20T11:43:39.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 shutdown_connections 2020-11-20T11:43:39.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 >> 172.21.15.112:0/163597230 conn(0x7f493405bac0 msgr2=0x7f49340c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:39.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 shutdown_connections 2020-11-20T11:43:39.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:39.968+0000 7f4939b50700 1 -- 172.21.15.112:0/163597230 wait complete. 2020-11-20T11:43:39.982 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:39.982 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:39.983 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:39.984 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T11:43:40.099 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 Processor -- start 2020-11-20T11:43:40.100 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 -- start start 2020-11-20T11:43:40.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2e0065d30 0x7ff2e0066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2e01512e0 0x7ff2e0151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.102 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00c5230 con 0x7ff2e00bfa50 2020-11-20T11:43:40.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e01549c0 con 0x7ff2e0065d30 2020-11-20T11:43:40.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.096+0000 7ff2e7967700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e0154c60 con 0x7ff2e01512e0 2020-11-20T11:43:40.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2e0065d30 0x7ff2e0066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.103 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2e0065d30 0x7ff2e0066110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51650/0 (socket says 172.21.15.112:51650) 2020-11-20T11:43:40.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 -- 172.21.15.112:0/349555644 learned_addr learned my addr 172.21.15.112:0/349555644 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5f04700 1 --2- 172.21.15.112:0/349555644 >> v2:172.21.15.204:3300/0 conn(0x7ff2e01512e0 0x7ff2e0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 -- 172.21.15.112:0/349555644 >> v2:172.21.15.204:3300/0 conn(0x7ff2e01512e0 msgr2=0x7ff2e0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 --2- 172.21.15.112:0/349555644 >> v2:172.21.15.204:3300/0 conn(0x7ff2e01512e0 0x7ff2e0151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.104 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 -- 172.21.15.112:0/349555644 >> v1:172.21.15.166:6789/0 conn(0x7ff2e00bfa50 legacy=0x7ff2e00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 -- 172.21.15.112:0/349555644 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0154f00 con 0x7ff2e0065d30 2020-11-20T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2e5703700 1 --2- 172.21.15.112:0/349555644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e0065d30 0x7ff2e0066110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff2e00651b0 tx=0x7ff2d0006ef0).ready entity=mon.0 client_cookie=5518ce00ca976d2d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2cffff700 1 -- 172.21.15.112:0/349555644 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000b860 con 0x7ff2e0065d30 2020-11-20T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2cffff700 1 -- 172.21.15.112:0/349555644 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0000e90 con 0x7ff2e0065d30 2020-11-20T11:43:40.105 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.097+0000 7ff2cffff700 1 -- 172.21.15.112:0/349555644 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000bbd0 con 0x7ff2e0065d30 2020-11-20T11:43:40.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 -- 172.21.15.112:0/349555644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e0065d30 msgr2=0x7ff2e0066110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 --2- 172.21.15.112:0/349555644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e0065d30 0x7ff2e0066110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff2e00651b0 tx=0x7ff2d0006ef0).stop 2020-11-20T11:43:40.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 -- 172.21.15.112:0/349555644 shutdown_connections 2020-11-20T11:43:40.106 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 --2- 172.21.15.112:0/349555644 >> v2:172.21.15.204:3300/0 conn(0x7ff2e01512e0 0x7ff2e0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 --2- 172.21.15.112:0/349555644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e0065d30 0x7ff2e0066110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 -- 172.21.15.112:0/349555644 >> 172.21.15.112:0/349555644 conn(0x7ff2e005bac0 msgr2=0x7ff2e005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 -- 172.21.15.112:0/349555644 shutdown_connections 2020-11-20T11:43:40.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.098+0000 7ff2e7967700 1 -- 172.21.15.112:0/349555644 wait complete. 2020-11-20T11:43:40.107 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.099+0000 7ff2e7967700 1 Processor -- start 2020-11-20T11:43:40.108 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.099+0000 7ff2e7967700 1 -- start start 2020-11-20T11:43:40.110 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff2e0065d30 0x7ff2e01647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.110 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.110 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2e01512e0 0x7ff2e014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00c6880 con 0x7ff2e00bfa50 2020-11-20T11:43:40.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0164cb0 con 0x7ff2e0065d30 2020-11-20T11:43:40.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00b2100 con 0x7ff2e01512e0 2020-11-20T11:43:40.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51658/0 (socket says 172.21.15.112:51658) 2020-11-20T11:43:40.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 -- 172.21.15.112:0/3169858524 learned_addr learned my addr 172.21.15.112:0/3169858524 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e5703700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff2e0065d30 0x7ff2e01647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e5f04700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2e01512e0 0x7ff2e014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.112 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 -- 172.21.15.112:0/3169858524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2e01512e0 msgr2=0x7ff2e014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2e01512e0 0x7ff2e014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 -- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff2e0065d30 msgr2=0x7ff2e01647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff2e0065d30 0x7ff2e01647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 -- 172.21.15.112:0/3169858524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00c5960 con 0x7ff2e00bfa50 2020-11-20T11:43:40.113 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e4f02700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff2dc00c710 tx=0x7ff2dc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc001ea0 con 0x7ff2e00bfa50 2020-11-20T11:43:40.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc013410 con 0x7ff2e00bfa50 2020-11-20T11:43:40.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00c5c00 con 0x7ff2e00bfa50 2020-11-20T11:43:40.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0137b0 con 0x7ff2e00bfa50 2020-11-20T11:43:40.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.100+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00c63e0 con 0x7ff2e00bfa50 2020-11-20T11:43:40.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.101+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e00c65a0 con 0x7ff2e00bfa50 2020-11-20T11:43:40.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.102+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff2dc010030 con 0x7ff2e00bfa50 2020-11-20T11:43:40.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.102+0000 7ff2cd7fa700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 0x7ff2b8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.102+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff2dc0a2be0 con 0x7ff2e00bfa50 2020-11-20T11:43:40.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.103+0000 7ff2e5703700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 0x7ff2b8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.116 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.103+0000 7ff2e5703700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 0x7ff2b8082b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff2d0006f30 tx=0x7ff2d0016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.116 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.105+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff2dc077510 con 0x7ff2e00bfa50 2020-11-20T11:43:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.246+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2e0065740 con 0x7ff2b8080670 2020-11-20T11:43:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.247+0000 7ff2cd7fa700 1 -- 172.21.15.112:0/3169858524 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2e0065740 con 0x7ff2b8080670 2020-11-20T11:43:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 msgr2=0x7ff2b8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 0x7ff2b8082b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff2d0006f30 tx=0x7ff2d0016000).stop 2020-11-20T11:43:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 msgr2=0x7ff2e00b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff2dc00c710 tx=0x7ff2dc007c40).stop 2020-11-20T11:43:40.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 shutdown_connections 2020-11-20T11:43:40.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff2b8080670 0x7ff2b8082b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2e01512e0 0x7ff2e014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff2e0065d30 0x7ff2e01647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.248+0000 7ff2e7967700 1 --2- 172.21.15.112:0/3169858524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2e00bfa50 0x7ff2e00b18b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.249+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 >> 172.21.15.112:0/3169858524 conn(0x7ff2e005bac0 msgr2=0x7ff2e005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.249+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 shutdown_connections 2020-11-20T11:43:40.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.249+0000 7ff2e7967700 1 -- 172.21.15.112:0/3169858524 wait complete. 2020-11-20T11:43:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T11:43:40.264 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T11:43:40.264 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:40.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.380+0000 7f4c9268e700 1 Processor -- start 2020-11-20T11:43:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.380+0000 7f4c9268e700 1 -- start start 2020-11-20T11:43:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c9268e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c8c066b60 0x7f4c8c066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c9268e700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 0x7f4c8c0c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c9268e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c151490 con 0x7f4c8c1518f0 2020-11-20T11:43:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c9268e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c064510 con 0x7f4c8c066b60 2020-11-20T11:43:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c9268e700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c063a90 con 0x7f4c8c0bb8e0 2020-11-20T11:43:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c8c066b60 0x7f4c8c066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c8c066b60 0x7f4c8c066f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51664/0 (socket says 172.21.15.112:51664) 2020-11-20T11:43:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 -- 172.21.15.112:0/2592661470 learned_addr learned my addr 172.21.15.112:0/2592661470 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8b7fe700 1 --2- 172.21.15.112:0/2592661470 >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 0x7f4c8c0c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 -- 172.21.15.112:0/2592661470 >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 msgr2=0x7f4c8c0c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 --2- 172.21.15.112:0/2592661470 >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 0x7f4c8c0c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 -- 172.21.15.112:0/2592661470 >> v1:172.21.15.166:6789/0 conn(0x7f4c8c1518f0 legacy=0x7f4c8c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8bfff700 1 -- 172.21.15.112:0/2592661470 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c063d30 con 0x7f4c8c066b60 2020-11-20T11:43:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.381+0000 7f4c8b7fe700 1 --2- 172.21.15.112:0/2592661470 >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 0x7f4c8c0c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c8bfff700 1 --2- 172.21.15.112:0/2592661470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c066b60 0x7f4c8c066f40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4c8c063480 tx=0x7f4c7c006ef0).ready entity=mon.0 client_cookie=79da36cc632041d9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c8affd700 1 -- 172.21.15.112:0/2592661470 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00b820 con 0x7f4c8c066b60 2020-11-20T11:43:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c8affd700 1 -- 172.21.15.112:0/2592661470 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c000e90 con 0x7f4c8c066b60 2020-11-20T11:43:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c8affd700 1 -- 172.21.15.112:0/2592661470 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00bb90 con 0x7f4c8c066b60 2020-11-20T11:43:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 -- 172.21.15.112:0/2592661470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c066b60 msgr2=0x7f4c8c066f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 --2- 172.21.15.112:0/2592661470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c066b60 0x7f4c8c066f40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4c8c063480 tx=0x7f4c7c006ef0).stop 2020-11-20T11:43:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 -- 172.21.15.112:0/2592661470 shutdown_connections 2020-11-20T11:43:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 --2- 172.21.15.112:0/2592661470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c066b60 0x7f4c8c066f40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 --2- 172.21.15.112:0/2592661470 >> v2:172.21.15.204:3300/0 conn(0x7f4c8c0bb8e0 0x7f4c8c0c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 -- 172.21.15.112:0/2592661470 >> 172.21.15.112:0/2592661470 conn(0x7f4c8c0bac60 msgr2=0x7f4c8c0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 -- 172.21.15.112:0/2592661470 shutdown_connections 2020-11-20T11:43:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.382+0000 7f4c9268e700 1 -- 172.21.15.112:0/2592661470 wait complete. 2020-11-20T11:43:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.383+0000 7f4c9268e700 1 Processor -- start 2020-11-20T11:43:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.383+0000 7f4c9268e700 1 -- start start 2020-11-20T11:43:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c8c066b60 0x7f4c8c0bf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c8c0bb8e0 0x7f4c8c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 0x7f4c8c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1530f0 con 0x7f4c8c1518f0 2020-11-20T11:43:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c160b40 con 0x7f4c8c066b60 2020-11-20T11:43:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c9268e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c160de0 con 0x7f4c8c0bb8e0 2020-11-20T11:43:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 0x7f4c8c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 0x7f4c8c152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51674/0 (socket says 172.21.15.112:51674) 2020-11-20T11:43:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 -- 172.21.15.112:0/1773703923 learned_addr learned my addr 172.21.15.112:0/1773703923 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c8b7fe700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c8c0bb8e0 0x7f4c8c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c8bfff700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c8c066b60 0x7f4c8c0bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 -- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c8c0bb8e0 msgr2=0x7f4c8c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c8c0bb8e0 0x7f4c8c152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 -- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c8c066b60 msgr2=0x7f4c8c0bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c8c066b60 0x7f4c8c0bf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c161080 con 0x7f4c8c1518f0 2020-11-20T11:43:40.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.384+0000 7f4c90c2b700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 0x7f4c8c152c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f4c8400ca60 tx=0x7f4c840023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400a7f0 con 0x7f4c8c1518f0 2020-11-20T11:43:40.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8400a970 con 0x7f4c8c1518f0 2020-11-20T11:43:40.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c161320 con 0x7f4c8c1518f0 2020-11-20T11:43:40.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400ad30 con 0x7f4c8c1518f0 2020-11-20T11:43:40.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c1607d0 con 0x7f4c8c1518f0 2020-11-20T11:43:40.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.385+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c8c156f10 con 0x7f4c8c1518f0 2020-11-20T11:43:40.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.386+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4c84010070 con 0x7f4c8c1518f0 2020-11-20T11:43:40.405 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c6bfff700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c64080670 0x7f4c64082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.405 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4c840a3450 con 0x7f4c8c1518f0 2020-11-20T11:43:40.405 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c6bfff700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7f4c640893a0 0x7f4c6408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c6408be20 con 0x7f4c640893a0 2020-11-20T11:43:40.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c840a37c0 con 0x7f4c8c1518f0 2020-11-20T11:43:40.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c8bfff700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c64080670 0x7f4c64082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c8b7fe700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7f4c640893a0 0x7f4c6408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.387+0000 7f4c8bfff700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c64080670 0x7f4c64082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4c7c00c010 tx=0x7f4c7c016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.388+0000 7f4c8b7fe700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7f4c640893a0 0x7f4c6408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.388+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== osd.5 v2:172.21.15.204:6808/23309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f4c6408be20 con 0x7f4c640893a0 2020-11-20T11:43:40.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.401+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 --> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c8c161780 con 0x7f4c640893a0 2020-11-20T11:43:40.409 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c6bfff700 1 -- 172.21.15.112:0/1773703923 <== osd.5 v2:172.21.15.204:6808/23309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4c8c161780 con 0x7f4c640893a0 2020-11-20T11:43:40.409 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7f4c640893a0 msgr2=0x7f4c6408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.409 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.204:6808/23309,v1:172.21.15.204:6809/23309] conn(0x7f4c640893a0 0x7f4c6408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.410 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c64080670 msgr2=0x7f4c64082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f4c64080670 0x7f4c64082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4c7c00c010 tx=0x7f4c7c016000).stop 2020-11-20T11:43:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 msgr2=0x7f4c8c152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 --2- 172.21.15.112:0/1773703923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c8c1518f0 0x7f4c8c152c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f4c8400ca60 tx=0x7f4c840023f0).stop 2020-11-20T11:43:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c90c2b700 1 -- 172.21.15.112:0/1773703923 reap_dead start 2020-11-20T11:43:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 shutdown_connections 2020-11-20T11:43:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 >> 172.21.15.112:0/1773703923 conn(0x7f4c8c0bac60 msgr2=0x7f4c8c149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 shutdown_connections 2020-11-20T11:43:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.402+0000 7f4c9268e700 1 -- 172.21.15.112:0/1773703923 wait complete. 2020-11-20T11:43:40.412 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:40.413 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:40.413 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:40.421 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T11:43:40.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.531+0000 7f45b359e700 1 Processor -- start 2020-11-20T11:43:40.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.531+0000 7f45b359e700 1 -- start start 2020-11-20T11:43:40.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b359e700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f45b4061aa0 0x7f45b4061e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b4060d20 con 0x7f45b41553b0 2020-11-20T11:43:40.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b359e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b40bc980 con 0x7f45b4151a90 2020-11-20T11:43:40.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b359e700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b40bc790 con 0x7f45b4061aa0 2020-11-20T11:43:40.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b1d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f45b41553b0 0x7f45b4060510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35874/0 (socket says 172.21.15.112:35874) 2020-11-20T11:43:40.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b1d9b700 1 -- 172.21.15.112:0/2080723384 learned_addr learned my addr 172.21.15.112:0/2080723384 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:40.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b259c700 1 --2- 172.21.15.112:0/2080723384 >> v2:172.21.15.166:3300/0 conn(0x7f45b4061aa0 0x7f45b4061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572517366 0 0) 0x7f45b4060d20 con 0x7f45b41553b0 2020-11-20T11:43:40.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4598003280 con 0x7f45b41553b0 2020-11-20T11:43:40.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1390612616 0 0) 0x7f4598003280 con 0x7f45b41553b0 2020-11-20T11:43:40.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 >> v2:172.21.15.166:3300/0 conn(0x7f45b4061aa0 msgr2=0x7f45b4061e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.540 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 --2- 172.21.15.112:0/2080723384 >> v2:172.21.15.166:3300/0 conn(0x7f45b4061aa0 0x7f45b4061e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 >> v1:172.21.15.166:6789/0 conn(0x7f45b4151a90 legacy=0x7f45b4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40bcc20 con 0x7f45b41553b0 2020-11-20T11:43:40.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2874490442 0 0) 0x7f45a4001520 con 0x7f45b41553b0 2020-11-20T11:43:40.541 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 >> v1:172.21.15.112:6789/0 conn(0x7f45b41553b0 legacy=0x7f45b4060510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45980037c0 0x7f4598003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 0x7f45980049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004e90 0x7f459800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4598005340 con 0x7f4598004520 2020-11-20T11:43:40.542 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459800bc60 con 0x7f4598004e90 2020-11-20T11:43:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.532+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459800bda0 con 0x7f45980037c0 2020-11-20T11:43:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 0x7f45980049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b2d9d700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004e90 0x7f459800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b259c700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45980037c0 0x7f4598003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 -- 172.21.15.112:0/2080723384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45980037c0 msgr2=0x7f4598003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45980037c0 0x7f4598003be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 -- 172.21.15.112:0/2080723384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004e90 msgr2=0x7f459800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004e90 0x7f459800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b2d9d700 1 -- 172.21.15.112:0/2080723384 reap_dead start 2020-11-20T11:43:40.544 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 -- 172.21.15.112:0/2080723384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598003280 con 0x7f4598004520 2020-11-20T11:43:40.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 0x7f45980049a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f45a400c440 tx=0x7f45b40bcdb0).ready entity=mon.0 client_cookie=3115ce8758fdbf51 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40070d0 con 0x7f4598004520 2020-11-20T11:43:40.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4007230 con 0x7f4598004520 2020-11-20T11:43:40.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b159a700 1 -- 172.21.15.112:0/2080723384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4005630 con 0x7f4598004520 2020-11-20T11:43:40.545 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b359e700 1 -- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 msgr2=0x7f45980049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b359e700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 0x7f45980049a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f45a400c440 tx=0x7f45b40bcdb0).stop 2020-11-20T11:43:40.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.533+0000 7f45b359e700 1 -- 172.21.15.112:0/2080723384 shutdown_connections 2020-11-20T11:43:40.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.534+0000 7f45b359e700 1 --2- 172.21.15.112:0/2080723384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4598004520 0x7f45980049a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.534+0000 7f45b359e700 1 -- 172.21.15.112:0/2080723384 >> 172.21.15.112:0/2080723384 conn(0x7f45b4063900 msgr2=0x7f45b4063d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.546 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.534+0000 7f45b359e700 1 -- 172.21.15.112:0/2080723384 shutdown_connections 2020-11-20T11:43:40.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.534+0000 7f45b359e700 1 -- 172.21.15.112:0/2080723384 wait complete. 2020-11-20T11:43:40.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 Processor -- start 2020-11-20T11:43:40.547 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 -- start start 2020-11-20T11:43:40.549 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004520 0x7f45b40b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b40c0130 0x7f45b4168410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40c2c40 con 0x7f45b40bfcf0 2020-11-20T11:43:40.550 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4156a90 con 0x7f4598004520 2020-11-20T11:43:40.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.535+0000 7f45b359e700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4168900 con 0x7f45b40c0130 2020-11-20T11:43:40.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51694/0 (socket says 172.21.15.112:51694) 2020-11-20T11:43:40.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 -- 172.21.15.112:0/1405316098 learned_addr learned my addr 172.21.15.112:0/1405316098 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.551 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b259c700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004520 0x7f45b40b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b2d9d700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b40c0130 0x7f45b4168410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 -- 172.21.15.112:0/1405316098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b40c0130 msgr2=0x7f45b4168410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b40c0130 0x7f45b4168410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.552 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 -- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004520 msgr2=0x7f45b40b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004520 0x7f45b40b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 -- 172.21.15.112:0/1405316098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4165730 con 0x7f45b40bfcf0 2020-11-20T11:43:40.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b1d9b700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f45a4008fd0 tx=0x7f45a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.553 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40073a0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4007500 con 0x7f45b40bfcf0 2020-11-20T11:43:40.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b4156cc0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4013680 con 0x7f45b40bfcf0 2020-11-20T11:43:40.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.536+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b40c27a0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.554 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.537+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b40008d0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.555 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.538+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f45a4027070 con 0x7f45b40bfcf0 2020-11-20T11:43:40.555 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.538+0000 7f45a27fc700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 0x7f4588082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.555 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.538+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f45a40a37e0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.555 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.538+0000 7f45b259c700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 0x7f4588082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.556 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.539+0000 7f45b259c700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 0x7f4588082b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45a8006d40 tx=0x7f45a8008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.556 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.542+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f45a40781f0 con 0x7f45b40bfcf0 2020-11-20T11:43:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.682+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f45b405d290 con 0x7f45880806a0 2020-11-20T11:43:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.683+0000 7f45a27fc700 1 -- 172.21.15.112:0/1405316098 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f45b405d290 con 0x7f45880806a0 2020-11-20T11:43:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 msgr2=0x7f4588082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 0x7f4588082b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45a8006d40 tx=0x7f45a8008040).stop 2020-11-20T11:43:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 msgr2=0x7f45b4167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f45a4008fd0 tx=0x7f45a4015000).stop 2020-11-20T11:43:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 shutdown_connections 2020-11-20T11:43:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f45880806a0 0x7f4588082b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45b40c0130 0x7f45b4168410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4598004520 0x7f45b40b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 --2- 172.21.15.112:0/1405316098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40bfcf0 0x7f45b4167f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 >> 172.21.15.112:0/1405316098 conn(0x7f45b4063900 msgr2=0x7f45b4060e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 shutdown_connections 2020-11-20T11:43:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.684+0000 7f45b359e700 1 -- 172.21.15.112:0/1405316098 wait complete. 2020-11-20T11:43:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T11:43:40.699 INFO:tasks.ceph:Scrubbing osd.8 2020-11-20T11:43:40.700 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:40.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.813+0000 7f7b9a9d7700 1 Processor -- start 2020-11-20T11:43:40.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.813+0000 7f7b9a9d7700 1 -- start start 2020-11-20T11:43:40.819 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b9a9d7700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 0x7f7b940c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b9a9d7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b94155700 0x7f7b94061220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b9a9d7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b941516b0 con 0x7f7b94061710 2020-11-20T11:43:40.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b9a9d7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b94155b60 con 0x7f7b94155700 2020-11-20T11:43:40.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b9a9d7700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b941518e0 con 0x7f7b940c5a10 2020-11-20T11:43:40.820 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b94155700 0x7f7b94061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b98f74700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7b94061710 0x7f7b94064720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35898/0 (socket says 172.21.15.112:35898) 2020-11-20T11:43:40.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b94155700 0x7f7b94061220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51700/0 (socket says 172.21.15.112:51700) 2020-11-20T11:43:40.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b98f74700 1 -- 172.21.15.112:0/2946805558 learned_addr learned my addr 172.21.15.112:0/2946805558 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:40.821 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b93fff700 1 --2- 172.21.15.112:0/2946805558 >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 0x7f7b940c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 -- 172.21.15.112:0/2946805558 >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 msgr2=0x7f7b940c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:40.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 --2- 172.21.15.112:0/2946805558 >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 0x7f7b940c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 -- 172.21.15.112:0/2946805558 >> v1:172.21.15.112:6789/0 conn(0x7f7b94061710 legacy=0x7f7b94064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 -- 172.21.15.112:0/2946805558 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94151b80 con 0x7f7b94155700 2020-11-20T11:43:40.822 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b92ffd700 1 -- 172.21.15.112:0/2946805558 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530703940 0 0) 0x7f7b941516b0 con 0x7f7b94061710 2020-11-20T11:43:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b93fff700 1 --2- 172.21.15.112:0/2946805558 >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 0x7f7b940c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b937fe700 1 --2- 172.21.15.112:0/2946805558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b94061220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7b940c3370 tx=0x7f7b84006e30).ready entity=mon.0 client_cookie=836982f47a854a84 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b92ffd700 1 -- 172.21.15.112:0/2946805558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840097b0 con 0x7f7b94155700 2020-11-20T11:43:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b92ffd700 1 -- 172.21.15.112:0/2946805558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84000e90 con 0x7f7b94155700 2020-11-20T11:43:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.814+0000 7f7b92ffd700 1 -- 172.21.15.112:0/2946805558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84009b20 con 0x7f7b94155700 2020-11-20T11:43:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/2946805558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 msgr2=0x7f7b94061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/2946805558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b94061220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7b940c3370 tx=0x7f7b84006e30).stop 2020-11-20T11:43:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/2946805558 shutdown_connections 2020-11-20T11:43:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/2946805558 >> v2:172.21.15.204:3300/0 conn(0x7f7b940c5a10 0x7f7b940c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/2946805558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b94061220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/2946805558 >> 172.21.15.112:0/2946805558 conn(0x7f7b940bbc50 msgr2=0x7f7b940bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/2946805558 shutdown_connections 2020-11-20T11:43:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.815+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/2946805558 wait complete. 2020-11-20T11:43:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.816+0000 7f7b9a9d7700 1 Processor -- start 2020-11-20T11:43:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.816+0000 7f7b9a9d7700 1 -- start start 2020-11-20T11:43:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7b94061710 0x7f7b940bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b940c5a10 0x7f7b94164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b940c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940bf4f0 con 0x7f7b94155700 2020-11-20T11:43:40.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94164a10 con 0x7f7b94061710 2020-11-20T11:43:40.835 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941571c0 con 0x7f7b940c5a10 2020-11-20T11:43:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b940c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b940c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51710/0 (socket says 172.21.15.112:51710) 2020-11-20T11:43:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 -- 172.21.15.112:0/1000826561 learned_addr learned my addr 172.21.15.112:0/1000826561 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b937fe700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b940c5a10 0x7f7b94164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b93fff700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7b94061710 0x7f7b940bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 -- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b940c5a10 msgr2=0x7f7b94164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b940c5a10 0x7f7b94164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 -- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7b94061710 msgr2=0x7f7b940bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7b94061710 0x7f7b940bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.837 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940bf250 con 0x7f7b94155700 2020-11-20T11:43:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b98f74700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b940c2640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7b8c00cae0 tx=0x7f7b8c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c005bc0 con 0x7f7b94155700 2020-11-20T11:43:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c005d20 con 0x7f7b94155700 2020-11-20T11:43:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c007360 con 0x7f7b94155700 2020-11-20T11:43:40.838 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94160720 con 0x7f7b94155700 2020-11-20T11:43:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.817+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94160c60 con 0x7f7b94155700 2020-11-20T11:43:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.818+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b941545f0 con 0x7f7b94155700 2020-11-20T11:43:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.819+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7b8c010030 con 0x7f7b94155700 2020-11-20T11:43:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.819+0000 7f7b73fff700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7b6c080670 0x7f7b6c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.839 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.819+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7b8c0a31b0 con 0x7f7b94155700 2020-11-20T11:43:40.840 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b73fff700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f7b6c0893a0 0x7f7b6c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.840 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b6c08be20 con 0x7f7b6c0893a0 2020-11-20T11:43:40.840 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b8c0a3520 con 0x7f7b94155700 2020-11-20T11:43:40.840 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b93fff700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7b6c080670 0x7f7b6c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.841 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b937fe700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f7b6c0893a0 0x7f7b6c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.841 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b93fff700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7b6c080670 0x7f7b6c082b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7b88006fd0 tx=0x7f7b88008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.841 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.820+0000 7f7b937fe700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f7b6c0893a0 0x7f7b6c08b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.841 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.821+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== osd.8 v2:172.21.15.204:6818/23310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f7b6c08be20 con 0x7f7b6c0893a0 2020-11-20T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.834+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 --> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b940666e0 con 0x7f7b6c0893a0 2020-11-20T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b73fff700 1 -- 172.21.15.112:0/1000826561 <== osd.8 v2:172.21.15.204:6818/23310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7b940666e0 con 0x7f7b6c0893a0 2020-11-20T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f7b6c0893a0 msgr2=0x7f7b6c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.204:6818/23310,v1:172.21.15.204:6820/23310] conn(0x7f7b6c0893a0 0x7f7b6c08b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.843 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7b6c080670 msgr2=0x7f7b6c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f7b6c080670 0x7f7b6c082b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7b88006fd0 tx=0x7f7b88008040).stop 2020-11-20T11:43:40.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 msgr2=0x7f7b940c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 --2- 172.21.15.112:0/1000826561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b94155700 0x7f7b940c2640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7b8c00cae0 tx=0x7f7b8c007dc0).stop 2020-11-20T11:43:40.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b98f74700 1 -- 172.21.15.112:0/1000826561 reap_dead start 2020-11-20T11:43:40.844 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 shutdown_connections 2020-11-20T11:43:40.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 >> 172.21.15.112:0/1000826561 conn(0x7f7b940bbc50 msgr2=0x7f7b940646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 shutdown_connections 2020-11-20T11:43:40.845 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.835+0000 7f7b9a9d7700 1 -- 172.21.15.112:0/1000826561 wait complete. 2020-11-20T11:43:40.845 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:40.846 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:40.850 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2020-11-20T11:43:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 Processor -- start 2020-11-20T11:43:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 -- start start 2020-11-20T11:43:40.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fb2e0066110 0x7fb2e00bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00c5230 con 0x7fb2e0065d30 2020-11-20T11:43:40.963 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e01549c0 con 0x7fb2e01512e0 2020-11-20T11:43:40.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.957+0000 7fb2e4874700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00bff40 con 0x7fb2e0066110 2020-11-20T11:43:40.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2de59c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb2e0065d30 0x7fb2e00c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35910/0 (socket says 172.21.15.112:35910) 2020-11-20T11:43:40.964 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2de59c700 1 -- 172.21.15.112:0/1277191362 learned_addr learned my addr 172.21.15.112:0/1277191362 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2ddd9b700 1 --2- 172.21.15.112:0/1277191362 >> v2:172.21.15.166:3300/0 conn(0x7fb2e0066110 0x7fb2e00bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2dd59a700 1 -- 172.21.15.112:0/1277191362 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814156225 0 0) 0x7fb2e00c5230 con 0x7fb2e0065d30 2020-11-20T11:43:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2dd59a700 1 -- 172.21.15.112:0/1277191362 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003280 con 0x7fb2e0065d30 2020-11-20T11:43:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2ddd9b700 1 -- 172.21.15.112:0/1277191362 >> v1:172.21.15.204:6789/0 conn(0x7fb2e01512e0 legacy=0x7fb2e0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2ddd9b700 1 -- 172.21.15.112:0/1277191362 >> v1:172.21.15.112:6789/0 conn(0x7fb2e0065d30 legacy=0x7fb2e00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2ddd9b700 1 -- 172.21.15.112:0/1277191362 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0154c60 con 0x7fb2e0066110 2020-11-20T11:43:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2ddd9b700 1 --2- 172.21.15.112:0/1277191362 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e0066110 0x7fb2e00bfa50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb2d4006fd0 tx=0x7fb2d4006e30).ready entity=mon.1 client_cookie=520c49dc815a89ff server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2dd59a700 1 -- 172.21.15.112:0/1277191362 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40097e0 con 0x7fb2e0066110 2020-11-20T11:43:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2dd59a700 1 -- 172.21.15.112:0/1277191362 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4000e90 con 0x7fb2e0066110 2020-11-20T11:43:40.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.958+0000 7fb2dd59a700 1 -- 172.21.15.112:0/1277191362 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4009b50 con 0x7fb2e0066110 2020-11-20T11:43:40.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 -- 172.21.15.112:0/1277191362 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e0066110 msgr2=0x7fb2e00bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 --2- 172.21.15.112:0/1277191362 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e0066110 0x7fb2e00bfa50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb2d4006fd0 tx=0x7fb2d4006e30).stop 2020-11-20T11:43:40.967 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 -- 172.21.15.112:0/1277191362 shutdown_connections 2020-11-20T11:43:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 --2- 172.21.15.112:0/1277191362 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e0066110 0x7fb2e00bfa50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 -- 172.21.15.112:0/1277191362 >> 172.21.15.112:0/1277191362 conn(0x7fb2e005bac0 msgr2=0x7fb2e005bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 -- 172.21.15.112:0/1277191362 shutdown_connections 2020-11-20T11:43:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.959+0000 7fb2e4874700 1 -- 172.21.15.112:0/1277191362 wait complete. 2020-11-20T11:43:40.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.960+0000 7fb2e4874700 1 Processor -- start 2020-11-20T11:43:40.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.960+0000 7fb2e4874700 1 -- start start 2020-11-20T11:43:40.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2e0066110 0x7fb2e0161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e01512e0 0x7fb2e00b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0161690 con 0x7fb2e0065d30 2020-11-20T11:43:40.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01536c0 con 0x7fb2e01512e0 2020-11-20T11:43:40.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2e4874700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0161150 con 0x7fb2e0066110 2020-11-20T11:43:40.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51722/0 (socket says 172.21.15.112:51722) 2020-11-20T11:43:40.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 -- 172.21.15.112:0/2827404838 learned_addr learned my addr 172.21.15.112:0/2827404838 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:40.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2ded9d700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e01512e0 0x7fb2e00b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2ddd9b700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2e0066110 0x7fb2e0161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 -- 172.21.15.112:0/2827404838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2e0066110 msgr2=0x7fb2e0161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2e0066110 0x7fb2e0161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 -- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e01512e0 msgr2=0x7fb2e00b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:40.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e01512e0 0x7fb2e00b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:40.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 -- 172.21.15.112:0/2827404838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e01613f0 con 0x7fb2e0065d30 2020-11-20T11:43:40.975 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.961+0000 7fb2de59c700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fb2d000c740 tx=0x7fb2d0007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00072e0 con 0x7fb2e0065d30 2020-11-20T11:43:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0007440 con 0x7fb2e0065d30 2020-11-20T11:43:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0005840 con 0x7fb2e0065d30 2020-11-20T11:43:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e01527f0 con 0x7fb2e0065d30 2020-11-20T11:43:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e0152d30 con 0x7fb2e0065d30 2020-11-20T11:43:40.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.962+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0065740 con 0x7fb2e0065d30 2020-11-20T11:43:40.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.963+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb2d0010070 con 0x7fb2e0065d30 2020-11-20T11:43:40.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.963+0000 7fb2ce7fc700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 0x7fb2b4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.964+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb2d00a1ff0 con 0x7fb2e0065d30 2020-11-20T11:43:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.964+0000 7fb2ddd9b700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 0x7fb2b4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.964+0000 7fb2ddd9b700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 0x7fb2b4082b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb2d4006e70 tx=0x7fb2d4015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:40.967+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb2d00769e0 con 0x7fb2e0065d30 2020-11-20T11:43:41.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.107+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e00666c0 con 0x7fb2b4080670 2020-11-20T11:43:41.111 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.108+0000 7fb2ce7fc700 1 -- 172.21.15.112:0/2827404838 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb2e00666c0 con 0x7fb2b4080670 2020-11-20T11:43:41.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 msgr2=0x7fb2b4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.114 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 0x7fb2b4082b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb2d4006e70 tx=0x7fb2d4015000).stop 2020-11-20T11:43:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 msgr2=0x7fb2e01531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fb2d000c740 tx=0x7fb2d0007b10).stop 2020-11-20T11:43:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 shutdown_connections 2020-11-20T11:43:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fb2b4080670 0x7fb2b4082b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb2e01512e0 0x7fb2e00b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e0065d30 0x7fb2e01531d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 --2- 172.21.15.112:0/2827404838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2e0066110 0x7fb2e0161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.117 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 >> 172.21.15.112:0/2827404838 conn(0x7fb2e005bac0 msgr2=0x7fb2e00c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.117 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 shutdown_connections 2020-11-20T11:43:41.117 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.109+0000 7fb2e4874700 1 -- 172.21.15.112:0/2827404838 wait complete. 2020-11-20T11:43:41.118 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 8 to deep-scrub 2020-11-20T11:43:41.125 INFO:tasks.ceph:Scrubbing osd.11 2020-11-20T11:43:41.125 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2020-11-20T11:43:41.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.236+0000 7f00f9de7700 1 Processor -- start 2020-11-20T11:43:41.240 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.236+0000 7f00f9de7700 1 -- start start 2020-11-20T11:43:41.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00f40c7a10 0x7f00f40c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.242 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 0x7f00f40bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00f40bff90 0x7f00f40c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40c4150 con 0x7f00f40c7a10 2020-11-20T11:43:41.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f4060790 con 0x7f00f40601b0 2020-11-20T11:43:41.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f9de7700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f4060a30 con 0x7f00f40bff90 2020-11-20T11:43:41.243 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f8de5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00f40c7a10 0x7f00f40c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f8de5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00f40c7a10 0x7f00f40c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51730/0 (socket says 172.21.15.112:51730) 2020-11-20T11:43:41.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f8de5700 1 -- 172.21.15.112:0/2567524756 learned_addr learned my addr 172.21.15.112:0/2567524756 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:41.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 0x7f00f40bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.244 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f95e6700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.204:3300/0 conn(0x7f00f40bff90 0x7f00f40c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.237+0000 7f00f8de5700 1 -- 172.21.15.112:0/2567524756 >> v2:172.21.15.204:3300/0 conn(0x7f00f40bff90 msgr2=0x7f00f40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.204:3300/0 conn(0x7f00f40bff90 0x7f00f40c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f8de5700 1 -- 172.21.15.112:0/2567524756 >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 msgr2=0x7f00f40bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 0x7f00f40bfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f8de5700 1 -- 172.21.15.112:0/2567524756 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4060cd0 con 0x7f00f40c7a10 2020-11-20T11:43:41.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 0x7f00f40bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:41.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2567524756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c7df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f00f40c8990 tx=0x7f00e8006ef0).ready entity=mon.0 client_cookie=bfb9353631c7171b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f37fe700 1 -- 172.21.15.112:0/2567524756 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800b830 con 0x7f00f40c7a10 2020-11-20T11:43:41.246 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f37fe700 1 -- 172.21.15.112:0/2567524756 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8000e90 con 0x7f00f40c7a10 2020-11-20T11:43:41.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f37fe700 1 -- 172.21.15.112:0/2567524756 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800bba0 con 0x7f00f40c7a10 2020-11-20T11:43:41.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 -- 172.21.15.112:0/2567524756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 msgr2=0x7f00f40c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2567524756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c7df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f00f40c8990 tx=0x7f00e8006ef0).stop 2020-11-20T11:43:41.247 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 -- 172.21.15.112:0/2567524756 shutdown_connections 2020-11-20T11:43:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.204:3300/0 conn(0x7f00f40bff90 0x7f00f40c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2567524756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c7df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2567524756 >> v2:172.21.15.166:3300/0 conn(0x7f00f40601b0 0x7f00f40bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 -- 172.21.15.112:0/2567524756 >> 172.21.15.112:0/2567524756 conn(0x7f00f405bac0 msgr2=0x7f00f4062240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 -- 172.21.15.112:0/2567524756 shutdown_connections 2020-11-20T11:43:41.250 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.238+0000 7f00f9de7700 1 -- 172.21.15.112:0/2567524756 wait complete. 2020-11-20T11:43:41.253 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.239+0000 7f00f9de7700 1 Processor -- start 2020-11-20T11:43:41.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.239+0000 7f00f9de7700 1 -- start start 2020-11-20T11:43:41.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f00f40601b0 0x7f00f4152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f40bff90 0x7f00f4164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.254 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4164f00 con 0x7f00f40c7a10 2020-11-20T11:43:41.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f414e760 con 0x7f00f40601b0 2020-11-20T11:43:41.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f9de7700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4152d30 con 0x7f00f40bff90 2020-11-20T11:43:41.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.255 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51740/0 (socket says 172.21.15.112:51740) 2020-11-20T11:43:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 -- 172.21.15.112:0/2684280023 learned_addr learned my addr 172.21.15.112:0/2684280023 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f40bff90 0x7f00f4164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f00f40601b0 0x7f00f4152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.256 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 -- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f40bff90 msgr2=0x7f00f4164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f40bff90 0x7f00f4164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 -- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f00f40601b0 msgr2=0x7f00f4152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.257 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f00f40601b0 0x7f00f4152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f95e6700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40bc970 con 0x7f00f40c7a10 2020-11-20T11:43:41.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f00f40601b0 0x7f00f4152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:41.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.240+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00f40bff90 0x7f00f4164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:43:41.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f95e6700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c15b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f00ec00cb50 tx=0x7f00ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.258 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00a900 con 0x7f00f40c7a10 2020-11-20T11:43:41.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00aa60 con 0x7f00f40c7a10 2020-11-20T11:43:41.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00ae20 con 0x7f00f40c7a10 2020-11-20T11:43:41.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40bcc10 con 0x7f00f40c7a10 2020-11-20T11:43:41.259 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4160bc0 con 0x7f00f40c7a10 2020-11-20T11:43:41.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.241+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00f40008d0 con 0x7f00f40c7a10 2020-11-20T11:43:41.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.242+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f00ec011620 con 0x7f00f40c7a10 2020-11-20T11:43:41.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f0ff9700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00cc0806a0 0x7f00cc082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.260 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f00ec0a38b0 con 0x7f00f40c7a10 2020-11-20T11:43:41.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f0ff9700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f00cc089450 0x7f00cc08b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00cc08bed0 con 0x7f00cc089450 2020-11-20T11:43:41.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00ec0a3be0 con 0x7f00f40c7a10 2020-11-20T11:43:41.261 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00cc0806a0 0x7f00cc082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f00cc089450 0x7f00cc08b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.262 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.243+0000 7f00f8de5700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00cc0806a0 0x7f00cc082b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f00e8009260 tx=0x7f00e8016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.244+0000 7f00f3fff700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f00cc089450 0x7f00cc08b870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.263 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.244+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== osd.11 v2:172.21.15.204:6816/23311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f00cc08bed0 con 0x7f00cc089450 2020-11-20T11:43:41.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.257+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 --> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00f4160d50 con 0x7f00cc089450 2020-11-20T11:43:41.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f0ff9700 1 -- 172.21.15.112:0/2684280023 <== osd.11 v2:172.21.15.204:6816/23311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f00f4160d50 con 0x7f00cc089450 2020-11-20T11:43:41.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f00cc089450 msgr2=0x7f00cc08b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.265 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.204:6816/23311,v1:172.21.15.204:6817/23311] conn(0x7f00cc089450 0x7f00cc08b870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00cc0806a0 msgr2=0x7f00cc082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f00cc0806a0 0x7f00cc082b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f00e8009260 tx=0x7f00e8016000).stop 2020-11-20T11:43:41.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 msgr2=0x7f00f40c15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.266 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f9de7700 1 --2- 172.21.15.112:0/2684280023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00f40c7a10 0x7f00f40c15b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f00ec00cb50 tx=0x7f00ec008040).stop 2020-11-20T11:43:41.267 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.258+0000 7f00f95e6700 1 -- 172.21.15.112:0/2684280023 reap_dead start 2020-11-20T11:43:41.267 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.259+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 shutdown_connections 2020-11-20T11:43:41.267 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.259+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 >> 172.21.15.112:0/2684280023 conn(0x7f00f405bac0 msgr2=0x7f00f40c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.267 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.259+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 shutdown_connections 2020-11-20T11:43:41.267 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.259+0000 7f00f9de7700 1 -- 172.21.15.112:0/2684280023 wait complete. 2020-11-20T11:43:41.268 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2020-11-20T11:43:41.268 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T11:43:41.268 INFO:teuthology.orchestra.run.smithi112.stdout:} 2020-11-20T11:43:41.273 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2020-11-20T11:43:41.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.379+0000 7ff83645f700 1 Processor -- start 2020-11-20T11:43:41.383 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.379+0000 7ff83645f700 1 -- start start 2020-11-20T11:43:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff83645f700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff83014c550 0x7ff83014f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff83645f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8300b8510 0x7ff830152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff83645f700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300bdc80 con 0x7ff83014c930 2020-11-20T11:43:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff83645f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8300b8990 con 0x7ff8300b8510 2020-11-20T11:43:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff83645f700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff830152880 con 0x7ff83014c550 2020-11-20T11:43:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff835c5e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8300b8510 0x7ff830152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff835c5e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8300b8510 0x7ff830152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51746/0 (socket says 172.21.15.112:51746) 2020-11-20T11:43:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.380+0000 7ff835c5e700 1 -- 172.21.15.112:0/450421334 learned_addr learned my addr 172.21.15.112:0/450421334 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:41.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff83545d700 1 --2- 172.21.15.112:0/450421334 >> v2:172.21.15.166:3300/0 conn(0x7ff83014c550 0x7ff83014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.393 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff835c5e700 1 -- 172.21.15.112:0/450421334 >> v2:172.21.15.166:3300/0 conn(0x7ff83014c550 msgr2=0x7ff83014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:41.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff835c5e700 1 --2- 172.21.15.112:0/450421334 >> v2:172.21.15.166:3300/0 conn(0x7ff83014c550 0x7ff83014f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff835c5e700 1 -- 172.21.15.112:0/450421334 >> v1:172.21.15.166:6789/0 conn(0x7ff83014c930 legacy=0x7ff8300c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:43:41.394 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff835c5e700 1 -- 172.21.15.112:0/450421334 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300bdeb0 con 0x7ff8300b8510 2020-11-20T11:43:41.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff835c5e700 1 --2- 172.21.15.112:0/450421334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8300b8510 0x7ff830152f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff8300c56a0 tx=0x7ff8280092d0).ready entity=mon.0 client_cookie=bc304d8a1da717c3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.395 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff81ffff700 1 -- 172.21.15.112:0/450421334 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800bbb0 con 0x7ff8300b8510 2020-11-20T11:43:41.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff81ffff700 1 -- 172.21.15.112:0/450421334 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800bd10 con 0x7ff8300b8510 2020-11-20T11:43:41.396 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff81ffff700 1 -- 172.21.15.112:0/450421334 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828011610 con 0x7ff8300b8510 2020-11-20T11:43:41.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff83645f700 1 -- 172.21.15.112:0/450421334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8300b8510 msgr2=0x7ff830152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.381+0000 7ff83645f700 1 --2- 172.21.15.112:0/450421334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8300b8510 0x7ff830152f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff8300c56a0 tx=0x7ff8280092d0).stop 2020-11-20T11:43:41.397 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 -- 172.21.15.112:0/450421334 shutdown_connections 2020-11-20T11:43:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 --2- 172.21.15.112:0/450421334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8300b8510 0x7ff830152f80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 --2- 172.21.15.112:0/450421334 >> v2:172.21.15.166:3300/0 conn(0x7ff83014c550 0x7ff83014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 -- 172.21.15.112:0/450421334 >> 172.21.15.112:0/450421334 conn(0x7ff830063900 msgr2=0x7ff830063d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 -- 172.21.15.112:0/450421334 shutdown_connections 2020-11-20T11:43:41.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.382+0000 7ff83645f700 1 -- 172.21.15.112:0/450421334 wait complete. 2020-11-20T11:43:41.399 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 Processor -- start 2020-11-20T11:43:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 -- start start 2020-11-20T11:43:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8300b8510 0x7ff8301629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff83014c550 0x7ff83014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830162ed0 con 0x7ff83014c930 2020-11-20T11:43:41.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83014d130 con 0x7ff83014c550 2020-11-20T11:43:41.401 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff83645f700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300b9f40 con 0x7ff8300b8510 2020-11-20T11:43:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.383+0000 7ff835c5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51754/0 (socket says 172.21.15.112:51754) 2020-11-20T11:43:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 -- 172.21.15.112:0/704251472 learned_addr learned my addr 172.21.15.112:0/704251472 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff834c5c700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff83014c550 0x7ff83014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff83545d700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8300b8510 0x7ff8301629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 -- 172.21.15.112:0/704251472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8300b8510 msgr2=0x7ff8301629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.403 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8300b8510 0x7ff8301629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 -- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff83014c550 msgr2=0x7ff83014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff83014c550 0x7ff83014ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 -- 172.21.15.112:0/704251472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300ba1e0 con 0x7ff83014c930 2020-11-20T11:43:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff835c5e700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ff82800b750 tx=0x7ff828016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.405 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828020070 con 0x7ff83014c930 2020-11-20T11:43:41.405 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8300ba480 con 0x7ff83014c930 2020-11-20T11:43:41.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8300ba9c0 con 0x7ff83014c930 2020-11-20T11:43:41.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800be80 con 0x7ff83014c930 2020-11-20T11:43:41.406 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.384+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828009ea0 con 0x7ff83014c930 2020-11-20T11:43:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.385+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300008d0 con 0x7ff83014c930 2020-11-20T11:43:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.386+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff828017070 con 0x7ff83014c930 2020-11-20T11:43:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.386+0000 7ff81d7fa700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 0x7ff808082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.387+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff8280a51a0 con 0x7ff83014c930 2020-11-20T11:43:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.387+0000 7ff83545d700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 0x7ff808082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.387+0000 7ff83545d700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 0x7ff808082b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff82c00b6b0 tx=0x7ff82c008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.409 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.389+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff828079bb0 con 0x7ff83014c930 2020-11-20T11:43:41.532 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.529+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7ff830068ea0 con 0x7ff8080806a0 2020-11-20T11:43:41.533 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.529+0000 7ff81d7fa700 1 -- 172.21.15.112:0/704251472 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7ff830068ea0 con 0x7ff8080806a0 2020-11-20T11:43:41.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 msgr2=0x7ff808082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.534 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 0x7ff808082b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff82c00b6b0 tx=0x7ff82c008040).stop 2020-11-20T11:43:41.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 msgr2=0x7ff83014e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.535 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7ff82800b750 tx=0x7ff828016000).stop 2020-11-20T11:43:41.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 shutdown_connections 2020-11-20T11:43:41.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7ff8080806a0 0x7ff808082b60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.536 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83014c930 0x7ff83014e4a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8300b8510 0x7ff8301629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.537 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 --2- 172.21.15.112:0/704251472 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff83014c550 0x7ff83014ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.530+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 >> 172.21.15.112:0/704251472 conn(0x7ff830063900 msgr2=0x7ff8300c1980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.538 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.531+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 shutdown_connections 2020-11-20T11:43:41.539 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.531+0000 7ff83645f700 1 -- 172.21.15.112:0/704251472 wait complete. 2020-11-20T11:43:41.541 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 11 to deep-scrub 2020-11-20T11:43:41.545 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:43:41.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.650+0000 7f31233df700 1 Processor -- start 2020-11-20T11:43:41.654 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.650+0000 7f31233df700 1 -- start start 2020-11-20T11:43:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.651+0000 7f31233df700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f311c0c5df0 0x7f311c155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.651+0000 7f31233df700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c1516b0 con 0x7f311c061930 2020-11-20T11:43:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.651+0000 7f31233df700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c1518e0 con 0x7f311c0c5a10 2020-11-20T11:43:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.651+0000 7f31233df700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c151b80 con 0x7f311c0c5df0 2020-11-20T11:43:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f311c0c5df0 0x7f311c155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312097a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f311c061930 0x7f311c064720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35954/0 (socket says 172.21.15.112:35954) 2020-11-20T11:43:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312097a700 1 -- 172.21.15.112:0/2433513627 learned_addr learned my addr 172.21.15.112:0/2433513627 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:43:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f311c0c5df0 0x7f311c155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51760/0 (socket says 172.21.15.112:51760) 2020-11-20T11:43:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 -- 172.21.15.112:0/2433513627 >> v1:172.21.15.204:6789/0 conn(0x7f311c0c5a10 legacy=0x7f311c061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 -- 172.21.15.112:0/2433513627 >> v1:172.21.15.112:6789/0 conn(0x7f311c061930 legacy=0x7f311c064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 -- 172.21.15.112:0/2433513627 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c151e20 con 0x7f311c0c5df0 2020-11-20T11:43:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f310bfff700 1 -- 172.21.15.112:0/2433513627 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787792429 0 0) 0x7f311c1516b0 con 0x7f311c061930 2020-11-20T11:43:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f312197c700 1 --2- 172.21.15.112:0/2433513627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c155700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3114009ce0 tx=0x7f3114009220).ready entity=mon.0 client_cookie=83c164230c272dcf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f310bfff700 1 -- 172.21.15.112:0/2433513627 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311400bbf0 con 0x7f311c0c5df0 2020-11-20T11:43:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f310bfff700 1 -- 172.21.15.112:0/2433513627 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311400bd50 con 0x7f311c0c5df0 2020-11-20T11:43:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.652+0000 7f310bfff700 1 -- 172.21.15.112:0/2433513627 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114011610 con 0x7f311c0c5df0 2020-11-20T11:43:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 -- 172.21.15.112:0/2433513627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 msgr2=0x7f311c155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 --2- 172.21.15.112:0/2433513627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c155700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3114009ce0 tx=0x7f3114009220).stop 2020-11-20T11:43:41.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 -- 172.21.15.112:0/2433513627 shutdown_connections 2020-11-20T11:43:41.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 --2- 172.21.15.112:0/2433513627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c155700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 -- 172.21.15.112:0/2433513627 >> 172.21.15.112:0/2433513627 conn(0x7f311c0bbc50 msgr2=0x7f311c0bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.660 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 -- 172.21.15.112:0/2433513627 shutdown_connections 2020-11-20T11:43:41.661 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.653+0000 7f31233df700 1 -- 172.21.15.112:0/2433513627 wait complete. 2020-11-20T11:43:41.663 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 Processor -- start 2020-11-20T11:43:41.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 -- start start 2020-11-20T11:43:41.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 0x7f311c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311c0c5a10 0x7f311c163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.664 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c160550 con 0x7f311c0c5df0 2020-11-20T11:43:41.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c164290 con 0x7f311c061930 2020-11-20T11:43:41.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.654+0000 7f31233df700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c164530 con 0x7f311c0c5a10 2020-11-20T11:43:41.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51766/0 (socket says 172.21.15.112:51766) 2020-11-20T11:43:41.665 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 -- 172.21.15.112:0/4141471496 learned_addr learned my addr 172.21.15.112:0/4141471496 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:43:41.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312097a700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311c0c5a10 0x7f311c163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312117b700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 0x7f311c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 -- 172.21.15.112:0/4141471496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311c0c5a10 msgr2=0x7f311c163ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311c0c5a10 0x7f311c163ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.666 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 -- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 msgr2=0x7f311c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 0x7f311c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 -- 172.21.15.112:0/4141471496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c1647d0 con 0x7f311c0c5df0 2020-11-20T11:43:41.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312117b700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 0x7f311c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:43:41.667 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f312197c700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f31140090b0 tx=0x7f3114016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114011e30 con 0x7f311c0c5df0 2020-11-20T11:43:41.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3114010ae0 con 0x7f311c0c5df0 2020-11-20T11:43:41.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c160730 con 0x7f311c0c5df0 2020-11-20T11:43:41.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114010e80 con 0x7f311c0c5df0 2020-11-20T11:43:41.668 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.655+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c163fa0 con 0x7f311c0c5df0 2020-11-20T11:43:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.656+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c160b90 con 0x7f311c0c5df0 2020-11-20T11:43:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.657+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3114017070 con 0x7f311c0c5df0 2020-11-20T11:43:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.657+0000 7f31097fa700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 0x7f30f4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:43:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.657+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f31140a5270 con 0x7f311c0c5df0 2020-11-20T11:43:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.657+0000 7f312117b700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 0x7f30f4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:43:41.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.658+0000 7f312117b700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 0x7f30f4082b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f31180015b0 tx=0x7f3118009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:43:41.670 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.661+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3114079c80 con 0x7f311c0c5df0 2020-11-20T11:43:41.805 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.801+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f311c064490 con 0x7f30f4080670 2020-11-20T11:43:41.810 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.807+0000 7f31097fa700 1 -- 172.21.15.112:0/4141471496 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149401 (secure 0 0 0) 0x7f311c064490 con 0x7f30f4080670 2020-11-20T11:43:41.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:43:41.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 msgr2=0x7f30f4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 0x7f30f4082b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f31180015b0 tx=0x7f3118009040).stop 2020-11-20T11:43:41.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 msgr2=0x7f311c160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:43:41.814 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f31140090b0 tx=0x7f3114016000).stop 2020-11-20T11:43:41.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 shutdown_connections 2020-11-20T11:43:41.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f30f4080670 0x7f30f4082b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c0c5df0 0x7f311c160e70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.815 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f311c061930 0x7f311c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 --2- 172.21.15.112:0/4141471496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f311c0c5a10 0x7f311c163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:43:41.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 >> 172.21.15.112:0/4141471496 conn(0x7f311c0bbc50 msgr2=0x7f311c0bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:43:41.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 shutdown_connections 2020-11-20T11:43:41.816 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:43:41.809+0000 7f31233df700 1 -- 172.21.15.112:0/4141471496 wait complete. 2020-11-20T11:43:41.817 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:43:41.824 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":794,"stamp":"2020-11-20T11:43:40.396747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":251392846,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":19623,"num_read_kb":1133421,"num_write":314269,"num_write_kb":6512176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160745,"ondisk_log_size":160745,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3923384,"kb_used_data":494616,"kb_used_omap":0,"kb_used_meta":3428672,"kb_avail":1128538696,"statfs":{"total":1159641169920,"available":1155623624704,"internally_reserved":0,"allocated":506486784,"data_stored":504445064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3510960128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-147133219,"num_objects":-1334,"num_object_clones":0,"num_object_copies":-5328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1334,"num_whiteouts":0,"num_read":2,"num_read_kb":132,"num_write":1346,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002681"},"pg_stats":[{"pgid":"4.2","version":"29'27790","reported_seq":"28992","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.144938+0000","last_change":"2020-11-20T11:18:02.984319+0000","last_active":"2020-11-20T11:43:34.144938+0000","last_peered":"2020-11-20T11:43:34.144938+0000","last_clean":"2020-11-20T11:43:34.144938+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:43:34.144938+0000","last_undegraded":"2020-11-20T11:43:34.144938+0000","last_fullsized":"2020-11-20T11:43:34.144938+0000","mapping_epoch":27,"log_start":"29'17744","ondisk_log_start":"29'17744","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10046,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1191,"num_read_kb":78290,"num_write":20463,"num_write_kb":728019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725498+0000","last_change":"2020-11-20T11:17:56.684598+0000","last_active":"2020-11-20T11:18:02.725498+0000","last_peered":"2020-11-20T11:18:02.725498+0000","last_clean":"2020-11-20T11:18:02.725498+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:18:02.725498+0000","last_undegraded":"2020-11-20T11:18:02.725498+0000","last_fullsized":"2020-11-20T11:18:02.725498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'23429","reported_seq":"23440","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:33.065351+0000","last_change":"2020-11-20T11:17:59.712095+0000","last_active":"2020-11-20T11:43:33.065351+0000","last_peered":"2020-11-20T11:43:33.065351+0000","last_clean":"2020-11-20T11:43:33.065351+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:43:33.065351+0000","last_undegraded":"2020-11-20T11:43:33.065351+0000","last_fullsized":"2020-11-20T11:43:33.065351+0000","mapping_epoch":24,"log_start":"29'13400","ondisk_log_start":"29'13400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10029,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":23460,"num_write_kb":165859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"29'27745","reported_seq":"29898","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.205165+0000","last_change":"2020-11-20T11:18:02.983813+0000","last_active":"2020-11-20T11:43:34.205165+0000","last_peered":"2020-11-20T11:43:34.205165+0000","last_clean":"2020-11-20T11:43:34.205165+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:43:34.205165+0000","last_undegraded":"2020-11-20T11:43:34.205165+0000","last_fullsized":"2020-11-20T11:43:34.205165+0000","mapping_epoch":27,"log_start":"29'17730","ondisk_log_start":"29'17730","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2142,"num_read_kb":148296,"num_write":20457,"num_write_kb":686402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727156+0000","last_change":"2020-11-20T11:17:56.596872+0000","last_active":"2020-11-20T11:18:02.727156+0000","last_peered":"2020-11-20T11:18:02.727156+0000","last_clean":"2020-11-20T11:18:02.727156+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:18:02.727156+0000","last_undegraded":"2020-11-20T11:18:02.727156+0000","last_fullsized":"2020-11-20T11:18:02.727156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'21468","reported_seq":"21479","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.247648+0000","last_change":"2020-11-20T11:18:00.078924+0000","last_active":"2020-11-20T11:43:18.247648+0000","last_peered":"2020-11-20T11:43:18.247648+0000","last_clean":"2020-11-20T11:43:18.247648+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:43:18.247648+0000","last_undegraded":"2020-11-20T11:43:18.247648+0000","last_fullsized":"2020-11-20T11:43:18.247648+0000","mapping_epoch":24,"log_start":"29'11400","ondisk_log_start":"29'11400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10068,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943074,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":21508,"num_write_kb":159909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"29'25905","reported_seq":"29318","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.164607+0000","last_change":"2020-11-20T11:18:02.983930+0000","last_active":"2020-11-20T11:43:34.164607+0000","last_peered":"2020-11-20T11:43:34.164607+0000","last_clean":"2020-11-20T11:43:34.164607+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:43:34.164607+0000","last_undegraded":"2020-11-20T11:43:34.164607+0000","last_fullsized":"2020-11-20T11:43:34.164607+0000","mapping_epoch":27,"log_start":"29'15875","ondisk_log_start":"29'15875","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10030,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3402,"num_read_kb":211712,"num_write":18641,"num_write_kb":503848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.730426+0000","last_change":"2020-11-20T11:17:56.650092+0000","last_active":"2020-11-20T11:18:02.730426+0000","last_peered":"2020-11-20T11:18:02.730426+0000","last_clean":"2020-11-20T11:18:02.730426+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:18:02.730426+0000","last_undegraded":"2020-11-20T11:18:02.730426+0000","last_fullsized":"2020-11-20T11:18:02.730426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'18505","reported_seq":"18516","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:22.980318+0000","last_change":"2020-11-20T11:18:00.079058+0000","last_active":"2020-11-20T11:43:22.980318+0000","last_peered":"2020-11-20T11:43:22.980318+0000","last_clean":"2020-11-20T11:43:22.980318+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:43:22.980318+0000","last_undegraded":"2020-11-20T11:43:22.980318+0000","last_fullsized":"2020-11-20T11:43:22.980318+0000","mapping_epoch":24,"log_start":"29'8500","ondisk_log_start":"29'8500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10005,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":18569,"num_write_kb":134049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"29'26715","reported_seq":"29056","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.190539+0000","last_change":"2020-11-20T11:18:02.735144+0000","last_active":"2020-11-20T11:43:34.190539+0000","last_peered":"2020-11-20T11:43:34.190539+0000","last_clean":"2020-11-20T11:43:34.190539+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:43:34.190539+0000","last_undegraded":"2020-11-20T11:43:34.190539+0000","last_fullsized":"2020-11-20T11:43:34.190539+0000","mapping_epoch":27,"log_start":"29'16620","ondisk_log_start":"29'16620","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":130128,"num_write":19349,"num_write_kb":649312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981614+0000","last_change":"2020-11-20T11:17:56.679644+0000","last_active":"2020-11-20T11:18:02.981614+0000","last_peered":"2020-11-20T11:18:02.981614+0000","last_clean":"2020-11-20T11:18:02.981614+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:18:02.981614+0000","last_undegraded":"2020-11-20T11:18:02.981614+0000","last_fullsized":"2020-11-20T11:18:02.981614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'3","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727126+0000","last_change":"2020-11-20T11:17:52.237351+0000","last_active":"2020-11-20T11:18:02.727126+0000","last_peered":"2020-11-20T11:18:02.727126+0000","last_clean":"2020-11-20T11:18:02.727126+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:18:02.727126+0000","last_undegraded":"2020-11-20T11:18:02.727126+0000","last_fullsized":"2020-11-20T11:18:02.727126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:46.208466+0000","last_clean_scrub_stamp":"2020-11-20T11:17:46.208466+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'22065","reported_seq":"22077","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:32.120371+0000","last_change":"2020-11-20T11:17:59.712995+0000","last_active":"2020-11-20T11:43:32.120371+0000","last_peered":"2020-11-20T11:43:32.120371+0000","last_clean":"2020-11-20T11:43:32.120371+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:43:32.120371+0000","last_undegraded":"2020-11-20T11:43:32.120371+0000","last_fullsized":"2020-11-20T11:43:32.120371+0000","mapping_epoch":24,"log_start":"29'12000","ondisk_log_start":"29'12000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10065,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26167910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22087,"num_write_kb":157238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'27059","reported_seq":"30146","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.165402+0000","last_change":"2020-11-20T11:18:02.984495+0000","last_active":"2020-11-20T11:43:34.165402+0000","last_peered":"2020-11-20T11:43:34.165402+0000","last_clean":"2020-11-20T11:43:34.165402+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:43:34.165402+0000","last_undegraded":"2020-11-20T11:43:34.165402+0000","last_fullsized":"2020-11-20T11:43:34.165402+0000","mapping_epoch":27,"log_start":"29'17048","ondisk_log_start":"29'17048","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3076,"num_read_kb":198434,"num_write":19655,"num_write_kb":812748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.727158+0000","last_change":"2020-11-20T11:17:56.679955+0000","last_active":"2020-11-20T11:18:02.727158+0000","last_peered":"2020-11-20T11:18:02.727158+0000","last_clean":"2020-11-20T11:18:02.727158+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:18:02.727158+0000","last_undegraded":"2020-11-20T11:18:02.727158+0000","last_fullsized":"2020-11-20T11:18:02.727158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15578","reported_seq":"16562","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.227426+0000","last_change":"2020-11-20T11:18:00.078954+0000","last_active":"2020-11-20T11:43:18.227426+0000","last_peered":"2020-11-20T11:43:18.227426+0000","last_clean":"2020-11-20T11:43:18.227426+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:43:18.227426+0000","last_undegraded":"2020-11-20T11:43:18.227426+0000","last_fullsized":"2020-11-20T11:43:18.227426+0000","mapping_epoch":24,"log_start":"29'5500","ondisk_log_start":"29'5500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10078,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":4817,"num_write":15600,"num_write_kb":119720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'26836","reported_seq":"28272","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.197334+0000","last_change":"2020-11-20T11:18:02.735416+0000","last_active":"2020-11-20T11:43:34.197334+0000","last_peered":"2020-11-20T11:43:34.197334+0000","last_clean":"2020-11-20T11:43:34.197334+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:43:34.197334+0000","last_undegraded":"2020-11-20T11:43:34.197334+0000","last_fullsized":"2020-11-20T11:43:34.197334+0000","mapping_epoch":27,"log_start":"29'16815","ondisk_log_start":"29'16815","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1425,"num_read_kb":95802,"num_write":19396,"num_write_kb":604990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.728849+0000","last_change":"2020-11-20T11:17:56.678488+0000","last_active":"2020-11-20T11:18:02.728849+0000","last_peered":"2020-11-20T11:18:02.728849+0000","last_clean":"2020-11-20T11:18:02.728849+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:18:02.728849+0000","last_undegraded":"2020-11-20T11:18:02.728849+0000","last_fullsized":"2020-11-20T11:18:02.728849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'21555","reported_seq":"22075","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:37.119326+0000","last_change":"2020-11-20T11:18:00.078835+0000","last_active":"2020-11-20T11:43:37.119326+0000","last_peered":"2020-11-20T11:43:37.119326+0000","last_clean":"2020-11-20T11:43:37.119326+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:43:37.119326+0000","last_undegraded":"2020-11-20T11:43:37.119326+0000","last_fullsized":"2020-11-20T11:43:37.119326+0000","mapping_epoch":24,"log_start":"29'11500","ondisk_log_start":"29'11500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10055,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53257703,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":512,"num_read_kb":3197,"num_write":21592,"num_write_kb":163023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"29'27800","reported_seq":"30319","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.211972+0000","last_change":"2020-11-20T11:18:02.984543+0000","last_active":"2020-11-20T11:43:34.211972+0000","last_peered":"2020-11-20T11:43:34.211972+0000","last_clean":"2020-11-20T11:43:34.211972+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:43:34.211972+0000","last_undegraded":"2020-11-20T11:43:34.211972+0000","last_fullsized":"2020-11-20T11:43:34.211972+0000","mapping_epoch":27,"log_start":"29'17742","ondisk_log_start":"29'17742","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10058,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2508,"num_read_kb":194578,"num_write":20501,"num_write_kb":678922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'12647","reported_seq":"13378","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:18.254607+0000","last_change":"2020-11-20T11:18:00.078852+0000","last_active":"2020-11-20T11:43:18.254607+0000","last_peered":"2020-11-20T11:43:18.254607+0000","last_clean":"2020-11-20T11:43:18.254607+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:43:18.254607+0000","last_undegraded":"2020-11-20T11:43:18.254607+0000","last_fullsized":"2020-11-20T11:43:18.254607+0000","mapping_epoch":24,"log_start":"29'2600","ondisk_log_start":"29'2600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20972095,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":722,"num_read_kb":4571,"num_write":12693,"num_write_kb":97715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.725499+0000","last_change":"2020-11-20T11:17:56.594357+0000","last_active":"2020-11-20T11:18:02.725499+0000","last_peered":"2020-11-20T11:18:02.725499+0000","last_clean":"2020-11-20T11:18:02.725499+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:18:02.725499+0000","last_undegraded":"2020-11-20T11:18:02.725499+0000","last_fullsized":"2020-11-20T11:18:02.725499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"29'27006","reported_seq":"28343","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.172894+0000","last_change":"2020-11-20T11:18:02.984521+0000","last_active":"2020-11-20T11:43:34.172894+0000","last_peered":"2020-11-20T11:43:34.172894+0000","last_clean":"2020-11-20T11:43:34.172894+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:43:34.172894+0000","last_undegraded":"2020-11-20T11:43:34.172894+0000","last_fullsized":"2020-11-20T11:43:34.172894+0000","mapping_epoch":27,"log_start":"29'16957","ondisk_log_start":"29'16957","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1326,"num_read_kb":63596,"num_write":19698,"num_write_kb":703697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:18:02.981711+0000","last_change":"2020-11-20T11:17:56.681946+0000","last_active":"2020-11-20T11:18:02.981711+0000","last_peered":"2020-11-20T11:18:02.981711+0000","last_clean":"2020-11-20T11:18:02.981711+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:18:02.981711+0000","last_undegraded":"2020-11-20T11:18:02.981711+0000","last_fullsized":"2020-11-20T11:18:02.981711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:55.578520+0000","last_clean_scrub_stamp":"2020-11-20T11:17:55.578520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'19970","reported_seq":"19981","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:27.105681+0000","last_change":"2020-11-20T11:17:59.712094+0000","last_active":"2020-11-20T11:43:27.105681+0000","last_peered":"2020-11-20T11:43:27.105681+0000","last_clean":"2020-11-20T11:43:27.105681+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:43:27.105681+0000","last_undegraded":"2020-11-20T11:43:27.105681+0000","last_fullsized":"2020-11-20T11:43:27.105681+0000","mapping_epoch":24,"log_start":"29'9900","ondisk_log_start":"29'9900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:17:58.699708+0000","last_clean_scrub_stamp":"2020-11-20T11:17:58.699708+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":20597,"num_write_kb":146710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17400,"num_read_kb":1120836,"num_write":158160,"num_write_kb":5367938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80325,"ondisk_log_size":80325,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":251392846,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":2223,"num_read_kb":12585,"num_write":156106,"num_write_kb":1144223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":502849536,"data_stored":502785692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80417,"ondisk_log_size":80417,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411640,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109424,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":109120,"kb_avail":94262416,"statfs":{"total":96636764160,"available":96524713984,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111738880},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.7669999999999999,"15min":1.264},"min":{"1min":0.62,"5min":0.57399999999999995,"15min":0.48199999999999998},"max":{"1min":4.2160000000000002,"5min":60.896000000000001,"15min":60.896000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.8999999999999999,"15min":1.329},"min":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"max":{"1min":1.9990000000000001,"5min":64.224000000000004,"15min":64.224000000000004},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.169,"15min":1.131},"min":{"1min":0.63,"5min":0.59299999999999997,"15min":0.56999999999999995},"max":{"1min":3.1240000000000001,"5min":5.4260000000000002,"15min":11.624000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3460000000000001,"15min":1.264},"min":{"1min":0.71699999999999997,"5min":0.59999999999999998,"15min":0.46600000000000003},"max":{"1min":1.9610000000000001,"5min":6.3129999999999997,"15min":6.375},"last":1.252}]},{"osd":2,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.24},"min":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":3.6059999999999999,"5min":9.5730000000000004,"15min":11.711},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.784,"5min":1.605,"15min":1.377},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.6820000000000004,"5min":10.047000000000001,"15min":10.047000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":3.5510000000000002,"5min":2.2730000000000001,"15min":1.786},"min":{"1min":0.82099999999999995,"5min":0.75,"15min":0.61899999999999999},"max":{"1min":41.573999999999998,"5min":41.573999999999998,"15min":41.573999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":3.6930000000000001,"5min":2.125,"15min":1.6639999999999999},"min":{"1min":0.88800000000000001,"5min":0.79100000000000004,"15min":0.60299999999999998},"max":{"1min":46.341999999999999,"5min":46.341999999999999,"15min":46.341999999999999},"last":1.1990000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.534,"15min":1.4430000000000001},"min":{"1min":0.86299999999999999,"5min":0.76600000000000001,"15min":0.626},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.3819999999999997},"last":1.036},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.7749999999999999,"15min":1.6439999999999999},"min":{"1min":0.93999999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0779999999999998,"5min":9.7059999999999995,"15min":9.7059999999999995},"last":1.5289999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":5.0979999999999999,"5min":2.7400000000000002,"15min":2.0369999999999999},"min":{"1min":1.044,"5min":0.85999999999999999,"15min":0.85699999999999998},"max":{"1min":22.707999999999998,"5min":22.707999999999998,"15min":22.707999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":6.4080000000000004,"5min":2.9460000000000002,"15min":2.0880000000000001},"min":{"1min":0.99299999999999999,"5min":0.96199999999999997,"15min":0.76600000000000001},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":1.232}]},{"osd":7,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.905,"15min":1.788},"min":{"1min":1.0429999999999999,"5min":0.97399999999999998,"15min":0.88300000000000001},"max":{"1min":2.206,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.746,"5min":1.8939999999999999,"15min":1.7669999999999999},"min":{"1min":1.02,"5min":0.96299999999999997,"15min":0.72199999999999998},"max":{"1min":4.6980000000000004,"5min":6.5750000000000002,"15min":12.638999999999999},"last":1.47}]},{"osd":9,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2160000000000002,"5min":1.988,"15min":1.806},"min":{"1min":1.085,"5min":1.0229999999999999,"15min":0.99299999999999999},"max":{"1min":7.1470000000000002,"5min":7.1470000000000002,"15min":9.8529999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.913,"5min":2.0449999999999999,"15min":1.921},"min":{"1min":1.026,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.7599999999999998,"5min":10.669,"15min":10.669},"last":1.6619999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.0609999999999999,"15min":1.857},"min":{"1min":1.1639999999999999,"5min":1.1040000000000001,"15min":1.0680000000000001},"max":{"1min":7.3390000000000004,"5min":7.3390000000000004,"15min":12.757},"last":1.554},{"interface":"front","average":{"1min":2.4220000000000002,"5min":1.944,"15min":1.786},"min":{"1min":1.133,"5min":1.105,"15min":0.98099999999999998},"max":{"1min":7.4139999999999997,"5min":7.4139999999999997,"15min":7.8620000000000001},"last":1.4199999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.9670000000000001,"15min":1.873},"min":{"1min":1.109,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.331,"5min":7.8179999999999996,"15min":7.8179999999999996},"last":1.794},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.3300000000000001,"15min":1.996},"min":{"1min":1.099,"5min":1.099,"15min":1.079},"max":{"1min":6.9530000000000003,"5min":7.859,"15min":12.827},"last":1.6279999999999999}]}]},{"osd":7,"up_from":18,"seq":77309411640,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192688,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":192384,"kb_avail":94179152,"statfs":{"total":96636764160,"available":96439451648,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":197001216},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2490000000000001,"15min":1.1579999999999999},"min":{"1min":0.58099999999999996,"5min":0.48999999999999999,"15min":0.45400000000000001},"max":{"1min":4.2850000000000001,"5min":5.6310000000000002,"15min":10.59},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.4750000000000001,"15min":1.4039999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.524,"5min":15.769,"15min":27.672999999999998},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.3380000000000001,"15min":1.2110000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2349999999999999,"5min":8.5679999999999996,"15min":8.5679999999999996},"last":1.361},{"interface":"front","average":{"1min":1.228,"5min":1.575,"15min":1.476},"min":{"1min":0.77000000000000002,"5min":0.63800000000000001,"15min":0.503},"max":{"1min":2.6869999999999998,"5min":8.6850000000000005,"15min":9.0530000000000008},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.4710000000000001,"15min":1.4770000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.60199999999999998},"max":{"1min":3.0099999999999998,"5min":7.5899999999999999,"15min":28.530000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.6359999999999999,"15min":1.4490000000000001},"min":{"1min":0.77300000000000002,"5min":0.65900000000000003,"15min":0.50600000000000001},"max":{"1min":2.109,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":1.194}]},{"osd":3,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.6990000000000001,"15min":1.5509999999999999},"min":{"1min":0.71999999999999997,"5min":0.65600000000000003,"15min":0.61699999999999999},"max":{"1min":5.5629999999999997,"5min":8.6660000000000004,"15min":8.6660000000000004},"last":1.123},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.7210000000000001,"15min":1.7569999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68799999999999994},"max":{"1min":3.113,"5min":7.4459999999999997,"15min":27.812000000000001},"last":1.054}]},{"osd":5,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.78,"15min":1.627},"min":{"1min":0.84799999999999998,"5min":0.69299999999999995,"15min":0.67400000000000004},"max":{"1min":3.6930000000000001,"5min":9.0139999999999993,"15min":10.208},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.8149999999999999,"15min":1.633},"min":{"1min":0.85499999999999998,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":2.165,"5min":12.459,"15min":12.459},"last":1.7549999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.7280000000000002,"15min":2.0049999999999999},"min":{"1min":0.95299999999999996,"5min":0.73199999999999998,"15min":0.69299999999999995},"max":{"1min":12.472,"5min":24.305,"15min":24.305},"last":0.89500000000000002},{"interface":"front","average":{"1min":2.6600000000000001,"5min":2.9700000000000002,"15min":2.2770000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":0.86899999999999999},"max":{"1min":21.210000000000001,"5min":24.324999999999999,"15min":24.324999999999999},"last":1.4219999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.8540000000000001,"15min":1.845},"min":{"1min":1.0369999999999999,"5min":0.93100000000000005,"15min":0.69799999999999995},"max":{"1min":3.2120000000000002,"5min":7.7149999999999999,"15min":28.039999999999999},"last":1.278},{"interface":"front","average":{"1min":1.679,"5min":2.0249999999999999,"15min":1.8120000000000001},"min":{"1min":1.1759999999999999,"5min":0.92800000000000005,"15min":0.83499999999999996},"max":{"1min":2.8460000000000001,"5min":8.0730000000000004,"15min":8.4949999999999992},"last":1.0249999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":2.1840000000000002,"15min":2.2440000000000002},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":8.4589999999999996,"15min":56.667999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.1749999999999998,"15min":2.1829999999999998},"min":{"1min":1.214,"5min":1.018,"15min":0.94999999999999996},"max":{"1min":3.7909999999999999,"5min":9.9740000000000002,"15min":55.774000000000001},"last":1.5720000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.9530000000000001,"15min":1.9159999999999999},"min":{"1min":1.089,"5min":1.034,"15min":0.71499999999999997},"max":{"1min":3.3130000000000002,"5min":7.835,"15min":27.931999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0089999999999999,"15min":2.0030000000000001},"min":{"1min":1.2669999999999999,"5min":1.1439999999999999,"15min":0.89000000000000001},"max":{"1min":2.8820000000000001,"5min":7.657,"15min":17.899000000000001},"last":1.5069999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":2.2290000000000001,"15min":1.9930000000000001},"min":{"1min":1.097,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":3.4860000000000002,"5min":8.8070000000000004,"15min":10.467000000000001},"last":1.698},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.2669999999999999,"15min":2.1389999999999998},"min":{"1min":1.2230000000000001,"5min":1.147,"15min":0.99299999999999999},"max":{"1min":5.8220000000000001,"5min":8.2260000000000009,"15min":28.638999999999999},"last":1.49}]}]},{"osd":1,"up_from":18,"seq":77309411639,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102192,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":101888,"kb_avail":94269648,"statfs":{"total":96636764160,"available":96532119552,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104333312},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1890000000000001,"15min":1.0029999999999999},"min":{"1min":0.60399999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":4.1379999999999999,"5min":4.7859999999999996,"15min":6.5350000000000001},"last":1.395},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.583,"15min":1.397},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":4.7830000000000004,"5min":4.9539999999999997,"15min":6.649},"last":1.792}]},{"osd":2,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.268,"15min":1.306},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.56299999999999994},"max":{"1min":3.7890000000000001,"5min":6.9470000000000001,"15min":29.122},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.0549999999999999},"min":{"1min":0.65400000000000003,"5min":0.59599999999999997,"15min":0.57899999999999996},"max":{"1min":2.6070000000000002,"5min":2.7229999999999999,"15min":3.9830000000000001},"last":1.53}]},{"osd":3,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.488,"15min":1.6699999999999999},"min":{"1min":0.76300000000000001,"5min":0.61099999999999999,"15min":0.60999999999999999},"max":{"1min":3.944,"5min":5.6719999999999997,"15min":69.046000000000006},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4179999999999999,"15min":1.6759999999999999},"min":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.343,"5min":5.0030000000000001,"15min":69.950000000000003},"last":1.6830000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.4690000000000001,"15min":1.367},"min":{"1min":0.93700000000000006,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.258,"5min":4.4779999999999998,"15min":6.3419999999999996},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.923,"5min":1.6519999999999999,"15min":1.5189999999999999},"min":{"1min":0.85199999999999998,"5min":0.70099999999999996,"15min":0.65200000000000002},"max":{"1min":4.4539999999999997,"5min":7.1079999999999997,"15min":7.1079999999999997},"last":1.004}]},{"osd":5,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5489999999999999,"15min":1.4750000000000001},"min":{"1min":0.88300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8210000000000002,"5min":6.3449999999999998,"15min":9.8879999999999999},"last":2.4100000000000001},{"interface":"front","average":{"1min":1.7509999999999999,"5min":1.659,"15min":1.5449999999999999},"min":{"1min":0.90200000000000002,"5min":0.86899999999999999,"15min":0.84199999999999997},"max":{"1min":4.4720000000000004,"5min":4.5960000000000001,"15min":5.8700000000000001},"last":1.6699999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":3.3580000000000001,"5min":2.7130000000000001,"15min":2.3620000000000001},"min":{"1min":1.0640000000000001,"5min":0.91700000000000004,"15min":0.84799999999999998},"max":{"1min":14.183,"5min":47.176000000000002,"15min":69.305999999999997},"last":1.1200000000000001},{"interface":"front","average":{"1min":3.4039999999999999,"5min":2.2229999999999999,"15min":1.889},"min":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.81299999999999994},"max":{"1min":19.556000000000001,"5min":19.556000000000001,"15min":19.556000000000001},"last":1.8140000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.8460000000000001,"15min":1.72},"min":{"1min":1.266,"5min":0.93700000000000006,"15min":0.92200000000000004},"max":{"1min":4.3689999999999998,"5min":5.46,"15min":7.5789999999999997},"last":2.1880000000000002},{"interface":"front","average":{"1min":2.1200000000000001,"5min":1.843,"15min":1.7969999999999999},"min":{"1min":1.0660000000000001,"5min":0.98299999999999998,"15min":0.92000000000000004},"max":{"1min":4.3310000000000004,"5min":7.1500000000000004,"15min":7.4699999999999998},"last":1.651}]},{"osd":8,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.956,"5min":1.821,"15min":1.724},"min":{"1min":1.0669999999999999,"5min":1.006,"15min":0.88900000000000001},"max":{"1min":5.0140000000000002,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":2.0459999999999998},{"interface":"front","average":{"1min":1.9279999999999999,"5min":1.948,"15min":1.7989999999999999},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":4.5759999999999996,"5min":5.056,"15min":5.452},"last":1.9119999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.657,"15min":2.1629999999999998},"min":{"1min":1.0860000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.8849999999999998,"5min":47.082000000000001,"15min":47.082000000000001},"last":2.0249999999999999},{"interface":"front","average":{"1min":2.1949999999999998,"5min":2.6160000000000001,"15min":2.1200000000000001},"min":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.028},"max":{"1min":4.2030000000000003,"5min":47.012999999999998,"15min":47.012999999999998},"last":1.5029999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:41 2020","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":1.9810000000000001,"15min":1.8360000000000001},"min":{"1min":1.23,"5min":1.0740000000000001,"15min":1.0640000000000001},"max":{"1min":3.6680000000000001,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":1.931},{"interface":"front","average":{"1min":2.5590000000000002,"5min":2.7690000000000001,"15min":2.1930000000000001},"min":{"1min":1.3440000000000001,"5min":1.2330000000000001,"15min":1.1459999999999999},"max":{"1min":6.3609999999999998,"5min":47.206000000000003,"15min":47.206000000000003},"last":2.1179999999999999}]}]},{"osd":11,"up_from":18,"seq":77309411640,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241912,"kb_used_data":20784,"kb_used_omap":0,"kb_used_meta":221120,"kb_avail":94129928,"statfs":{"total":96636764160,"available":96389046272,"internally_reserved":0,"allocated":21282816,"data_stored":21110376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":226426880},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.268,"15min":1.111},"min":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.6880000000000002,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.754},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3100000000000001,"15min":1.2090000000000001},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.55900000000000005},"max":{"1min":8.9870000000000001,"5min":11.206,"15min":11.206},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":4.1840000000000002,"15min":2.036},"min":{"1min":0.67200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9279999999999999,"5min":310.21100000000001,"15min":310.21100000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.3999999999999999,"5min":4.258,"15min":2.2709999999999999},"min":{"1min":0.81899999999999995,"5min":0.625,"15min":0.54700000000000004},"max":{"1min":3.8029999999999999,"5min":310.233,"15min":310.233},"last":1.095}]},{"osd":2,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.3180000000000001,"15min":1.2330000000000001},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.54400000000000004},"max":{"1min":2.4740000000000002,"5min":6.7220000000000004,"15min":6.7220000000000004},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.48,"15min":1.335},"min":{"1min":0.82999999999999996,"5min":0.69399999999999995,"15min":0.69099999999999995},"max":{"1min":2.4500000000000002,"5min":6.3550000000000004,"15min":6.9199999999999999},"last":1.2829999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.865,"15min":1.6259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71399999999999997,"15min":0.625},"max":{"1min":8.7300000000000004,"5min":8.7300000000000004,"15min":15.169},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.899,"5min":1.9830000000000001,"15min":1.8080000000000001},"min":{"1min":1.089,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":8.6950000000000003,"5min":8.6950000000000003,"15min":20.972000000000001},"last":1.3700000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":4.665,"15min":2.4249999999999998},"min":{"1min":0.83199999999999996,"5min":0.68300000000000005,"15min":0.60199999999999998},"max":{"1min":7.7290000000000001,"5min":310.73899999999998,"15min":310.73899999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.3050000000000002,"5min":4.6429999999999998,"15min":2.5720000000000001},"min":{"1min":1.1180000000000001,"5min":0.90300000000000002,"15min":0.79800000000000004},"max":{"1min":7.0599999999999996,"5min":309.93700000000001,"15min":309.93700000000001},"last":1.252}]},{"osd":5,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":1.877,"15min":1.718},"min":{"1min":1.056,"5min":0.85299999999999998,"15min":0.79700000000000004},"max":{"1min":3.3530000000000002,"5min":6.8029999999999999,"15min":7.3010000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.0459999999999998,"15min":1.792},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":7.5919999999999996,"5min":7.5919999999999996,"15min":7.7649999999999997},"last":1.571}]},{"osd":6,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":2.3900000000000001,"15min":1.978},"min":{"1min":1.1719999999999999,"5min":0.90800000000000003,"15min":0.83899999999999997},"max":{"1min":8.9239999999999995,"5min":8.9239999999999995,"15min":11.238},"last":1.141},{"interface":"front","average":{"1min":2.738,"5min":2.2650000000000001,"15min":1.9730000000000001},"min":{"1min":0.998,"5min":0.97699999999999998,"15min":0.91800000000000004},"max":{"1min":9.952,"5min":9.952,"15min":11.032},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.1240000000000001,"5min":4.859,"15min":2.923},"min":{"1min":1.2509999999999999,"5min":1.0880000000000001,"15min":0.753},"max":{"1min":8.532,"5min":310.26100000000002,"15min":310.26100000000002},"last":1.7050000000000001},{"interface":"front","average":{"1min":2.589,"5min":5.1820000000000004,"15min":3.04},"min":{"1min":1.038,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":8.7989999999999995,"5min":313.202,"15min":313.202},"last":1.4259999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.238,"5min":2.077,"15min":1.9159999999999999},"min":{"1min":1.256,"5min":1,"15min":1},"max":{"1min":8.7349999999999994,"5min":8.8000000000000007,"15min":11.145},"last":1.544},{"interface":"front","average":{"1min":1.8049999999999999,"5min":1.994,"15min":1.849},"min":{"1min":1.284,"5min":1.1499999999999999,"15min":0.84599999999999997},"max":{"1min":2.968,"5min":8.4100000000000001,"15min":8.4100000000000001},"last":1.508}]},{"osd":10,"last update":"Fri Nov 20 11:42:43 2020","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":4.9000000000000004,"15min":2.8500000000000001},"min":{"1min":1.21,"5min":1.069,"15min":1.069},"max":{"1min":7.5330000000000004,"5min":311.82799999999997,"15min":311.82799999999997},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.8240000000000001,"5min":4.9119999999999999,"15min":2.8290000000000002},"min":{"1min":1.3799999999999999,"5min":1.2210000000000001,"15min":1.0880000000000001},"max":{"1min":3.8250000000000002,"5min":310.40800000000002,"15min":310.40800000000002},"last":1.631}]}]},{"osd":10,"up_from":18,"seq":77309411640,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":522300,"kb_used_data":65844,"kb_used_omap":0,"kb_used_meta":456448,"kb_avail":93849540,"statfs":{"total":96636764160,"available":96101928960,"internally_reserved":0,"allocated":67424256,"data_stored":67247339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":467402752},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.659,"15min":1.298},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":5.3129999999999997,"5min":17.451000000000001,"15min":17.451000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.5880000000000001,"15min":1.389},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":3.5510000000000002,"5min":17.646000000000001,"15min":17.646000000000001},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1619999999999999,"15min":1.1220000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.59699999999999998},"max":{"1min":4.194,"5min":14.58,"15min":14.58},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.532,"5min":1.5509999999999999,"15min":1.4199999999999999},"min":{"1min":0.749,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":5.1070000000000002,"5min":16.050999999999998,"15min":16.050999999999998},"last":0.98299999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.2849999999999999,"15min":1.325},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.407,"5min":5.1550000000000002,"15min":27},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.2869999999999999,"15min":1.3169999999999999},"min":{"1min":0.71099999999999997,"5min":0.66000000000000003,"15min":0.64800000000000002},"max":{"1min":4.391,"5min":4.6459999999999999,"15min":9.8219999999999992},"last":1.044}]},{"osd":3,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2789999999999999,"5min":1.8300000000000001,"15min":1.5269999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.64500000000000002},"max":{"1min":7.532,"5min":15.452999999999999,"15min":15.452999999999999},"last":0.878},{"interface":"front","average":{"1min":2.0859999999999999,"5min":1.7809999999999999,"15min":1.6990000000000001},"min":{"1min":0.88200000000000001,"5min":0.69999999999999996,"15min":0.69799999999999995},"max":{"1min":5.2050000000000001,"5min":5.2789999999999999,"15min":16.129999999999999},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":1.669,"15min":1.534},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.69099999999999995},"max":{"1min":3.8860000000000001,"5min":6.0940000000000003,"15min":7.3049999999999997},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.907,"5min":1.6279999999999999,"15min":1.5489999999999999},"min":{"1min":0.93600000000000005,"5min":0.92000000000000004,"15min":0.70799999999999996},"max":{"1min":7.2119999999999997,"5min":7.2119999999999997,"15min":9.3699999999999992},"last":1.145}]},{"osd":5,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":2.0489999999999999,"15min":1.8700000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.745},"max":{"1min":6.5750000000000002,"5min":15.561,"15min":40.746000000000002},"last":1.1259999999999999},{"interface":"front","average":{"1min":2.1400000000000001,"5min":1.929,"15min":1.8},"min":{"1min":1.0249999999999999,"5min":0.92100000000000004,"15min":0.64900000000000002},"max":{"1min":4.0110000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":3.5219999999999998,"5min":2.7570000000000001,"15min":2.133},"min":{"1min":1.1930000000000001,"5min":1.1060000000000001,"15min":0.91800000000000004},"max":{"1min":20.754000000000001,"5min":21.189,"15min":21.189},"last":1.222},{"interface":"front","average":{"1min":3.8690000000000002,"5min":2.9900000000000002,"15min":2.246},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":21.001999999999999,"5min":22.416,"15min":22.416},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2749999999999999,"5min":2.1269999999999998,"15min":1.944},"min":{"1min":1.147,"5min":1.147,"15min":0.97799999999999998},"max":{"1min":4.1319999999999997,"5min":9.4939999999999998,"15min":18.797999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.8120000000000001,"15min":1.8140000000000001},"min":{"1min":1.165,"5min":1.105,"15min":1.008},"max":{"1min":4.6319999999999997,"5min":6.7699999999999996,"15min":9.6400000000000006},"last":1.369}]},{"osd":9,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.0129999999999999,"15min":1.944},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.143},"max":{"1min":7.8559999999999999,"5min":9.9090000000000007,"15min":9.9090000000000007},"last":1.2969999999999999},{"interface":"front","average":{"1min":2.274,"5min":2.169,"15min":2.0470000000000002},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":5.5179999999999998,"5min":15.627000000000001,"15min":15.627000000000001},"last":1.2090000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:42:49 2020","interfaces":[{"interface":"back","average":{"1min":2.6970000000000001,"5min":2.2610000000000001,"15min":2.1040000000000001},"min":{"1min":1.282,"5min":1.1539999999999999,"15min":1.044},"max":{"1min":6.8559999999999999,"5min":6.8970000000000002,"15min":10.279},"last":1.264},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9259999999999999,"15min":1.9239999999999999},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":5.0510000000000002,"5min":6.2119999999999997,"15min":10.076000000000001},"last":1.4319999999999999}]}]},{"osd":9,"up_from":18,"seq":77309411639,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153136,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":152832,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":156499968},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.631,"15min":1.488},"min":{"1min":0.64500000000000002,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":4.4630000000000001,"5min":9.2539999999999996,"15min":14.436},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.595,"5min":1.7230000000000001,"15min":1.5},"min":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.56299999999999994},"max":{"1min":6.8979999999999997,"5min":7.2480000000000002,"15min":14.875999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.512,"15min":1.3240000000000001},"min":{"1min":0.629,"5min":0.61299999999999999,"15min":0.58099999999999996},"max":{"1min":4.6420000000000003,"5min":6.8410000000000002,"15min":6.8410000000000002},"last":4.5209999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.649,"15min":1.55},"min":{"1min":0.82399999999999995,"5min":0.66500000000000004,"15min":0.66400000000000003},"max":{"1min":4.6840000000000002,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":2.1099999999999999,"15min":1.919},"min":{"1min":0.999,"5min":0.67600000000000005,"15min":0.52800000000000002},"max":{"1min":6.4580000000000002,"5min":10.744,"15min":67.947000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.0339999999999998,"15min":1.881},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66300000000000003},"max":{"1min":4.0899999999999999,"5min":11.935,"15min":67.694999999999993},"last":4.5940000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":2.0649999999999999,"15min":1.9530000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":2.7330000000000001,"5min":7.4960000000000004,"15min":27.167000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.3069999999999999,"5min":2.4049999999999998,"15min":2.3420000000000001},"min":{"1min":0.92900000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"max":{"1min":6.7859999999999996,"5min":7.4420000000000002,"15min":50.762},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":2.0299999999999998,"15min":1.8720000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.72599999999999998},"max":{"1min":2.8660000000000001,"5min":7.3529999999999998,"15min":7.3529999999999998},"last":1.294},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.278,"15min":1.9550000000000001},"min":{"1min":1.127,"5min":1.0069999999999999,"15min":0.77500000000000002},"max":{"1min":6.577,"5min":7.0170000000000003,"15min":7.0170000000000003},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":2.1850000000000001,"15min":2.2229999999999999},"min":{"1min":1.143,"5min":1.0680000000000001,"15min":0.97799999999999998},"max":{"1min":2.8170000000000002,"5min":6.8559999999999999,"15min":66.474000000000004},"last":1.5900000000000001},{"interface":"front","average":{"1min":2.476,"5min":2.4649999999999999,"15min":2.3540000000000001},"min":{"1min":1.3240000000000001,"5min":1.071,"15min":0.82799999999999996},"max":{"1min":6.6829999999999998,"5min":7.1849999999999996,"15min":66.432000000000002},"last":1.119}]},{"osd":6,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":3.2509999999999999,"15min":3.282},"min":{"1min":0.96699999999999997,"5min":0.89800000000000002,"15min":0.79000000000000004},"max":{"1min":10.946,"5min":17.698,"15min":177.542},"last":4.8840000000000003},{"interface":"front","average":{"1min":2.8570000000000002,"5min":3.4390000000000001,"15min":3.48},"min":{"1min":1.3080000000000001,"5min":1.2949999999999999,"15min":1.1180000000000001},"max":{"1min":11.071999999999999,"5min":16.709,"15min":178.292},"last":1.5}]},{"osd":8,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":2.4289999999999998,"15min":2.3980000000000001},"min":{"1min":1.034,"5min":1.0309999999999999,"15min":0.88100000000000001},"max":{"1min":6.9370000000000003,"5min":12.064,"15min":66.763999999999996},"last":5.0039999999999996},{"interface":"front","average":{"1min":2.3319999999999999,"5min":2.5219999999999998,"15min":2.5470000000000002},"min":{"1min":1.393,"5min":1.2170000000000001,"15min":1.04},"max":{"1min":7.3819999999999997,"5min":7.9100000000000001,"15min":65.933999999999997},"last":1.365}]},{"osd":10,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.476,"5min":2.528,"15min":2.2229999999999999},"min":{"1min":1.0549999999999999,"5min":0.96799999999999997,"15min":0.94499999999999995},"max":{"1min":8.3249999999999993,"5min":11.321999999999999,"15min":11.321999999999999},"last":5.0759999999999996},{"interface":"front","average":{"1min":2.2360000000000002,"5min":2.577,"15min":2.379},"min":{"1min":1.4910000000000001,"5min":1.153,"15min":0.91100000000000003},"max":{"1min":6.6609999999999996,"5min":7.2210000000000001,"15min":7.2210000000000001},"last":1.4339999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:35 2020","interfaces":[{"interface":"back","average":{"1min":2.7029999999999998,"5min":2.7349999999999999,"15min":2.5419999999999998},"min":{"1min":1.196,"5min":1.1659999999999999,"15min":0.95899999999999996},"max":{"1min":7.0039999999999996,"5min":7.782,"15min":66.094999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":2.2799999999999998,"5min":2.5110000000000001,"15min":2.5179999999999998},"min":{"1min":1.173,"5min":1.133,"15min":1.014},"max":{"1min":3.54,"5min":11.57,"15min":66.566000000000003},"last":5.1420000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411639,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350052,"kb_used_data":64604,"kb_used_omap":0,"kb_used_meta":285440,"kb_avail":94021788,"statfs":{"total":96636764160,"available":96278310912,"internally_reserved":0,"allocated":66154496,"data_stored":65978896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":292290560},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3109999999999999,"15min":1.163},"min":{"1min":0.65300000000000002,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":5.056,"5min":13.025,"15min":13.025},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.373,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.59499999999999997,"15min":0.56499999999999995},"max":{"1min":4.0609999999999999,"5min":12.997,"15min":12.997},"last":0.94599999999999995}]},{"osd":3,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5189999999999999,"15min":1.3029999999999999},"min":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":2.9279999999999999,"5min":13.821999999999999,"15min":13.821999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":5.3719999999999999,"5min":13.683999999999999,"15min":13.683999999999999},"last":1.194}]},{"osd":4,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.75,"15min":1.4370000000000001},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"max":{"1min":4.1269999999999998,"5min":14.170999999999999,"15min":14.170999999999999},"last":1.173},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.754,"15min":1.633},"min":{"1min":0.75700000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":5.8490000000000002,"5min":14.146000000000001,"15min":14.146000000000001},"last":1.3169999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.782,"15min":1.5269999999999999},"min":{"1min":0.629,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.4880000000000004,"5min":13.715999999999999,"15min":13.715999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.663,"5min":1.829,"15min":1.548},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.9140000000000001,"5min":14.430999999999999,"15min":14.430999999999999},"last":1.288}]},{"osd":6,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6799999999999997,"5min":2.9209999999999998,"15min":2.1269999999999998},"min":{"1min":1.01,"5min":0.85799999999999998,"15min":0.65400000000000003},"max":{"1min":28.844000000000001,"5min":28.844000000000001,"15min":28.844000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":4.6680000000000001,"5min":2.7320000000000002,"15min":1.988},"min":{"1min":0.86699999999999999,"5min":0.80800000000000005,"15min":0.70699999999999996},"max":{"1min":29.361000000000001,"5min":29.361000000000001,"15min":29.361000000000001},"last":1.3879999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.891,"15min":1.804},"min":{"1min":0.87,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":5.4409999999999998,"5min":14.004,"15min":14.004},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.734,"5min":2.0379999999999998,"15min":1.794},"min":{"1min":1.171,"5min":1.0069999999999999,"15min":0.96399999999999997},"max":{"1min":4.9470000000000001,"5min":13.478,"15min":13.478},"last":1.659}]},{"osd":8,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":2.016,"15min":1.8759999999999999},"min":{"1min":1.127,"5min":0.96099999999999997,"15min":0.94799999999999995},"max":{"1min":5.2969999999999997,"5min":13.861000000000001,"15min":13.861000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.778,"5min":2.234,"15min":1.97},"min":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":5.1790000000000003,"5min":13.359,"15min":13.359},"last":1.544}]},{"osd":9,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":3.6469999999999998,"5min":2.5409999999999999,"15min":2.0870000000000002},"min":{"1min":1.046,"5min":1.046,"15min":1.0429999999999999},"max":{"1min":28.672999999999998,"5min":28.672999999999998,"15min":28.672999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.222,"15min":2.0390000000000001},"min":{"1min":1.091,"5min":1.091,"15min":1.091},"max":{"1min":5.726,"5min":14.271000000000001,"15min":14.271000000000001},"last":1.802}]},{"osd":10,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":2.2109999999999999,"15min":1.9039999999999999},"min":{"1min":1.147,"5min":1.1120000000000001,"15min":1.0289999999999999},"max":{"1min":5.0629999999999997,"5min":13.597,"15min":13.597},"last":1.873},{"interface":"front","average":{"1min":2.1880000000000002,"5min":2.1739999999999999,"15min":1.9490000000000001},"min":{"1min":1.1180000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":5.5140000000000002,"5min":14.555,"15min":14.555},"last":1.5269999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:42:32 2020","interfaces":[{"interface":"back","average":{"1min":2.2210000000000001,"5min":2.2930000000000001,"15min":2.1299999999999999},"min":{"1min":1.3160000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":5.5709999999999997,"5min":14.396000000000001,"15min":14.396000000000001},"last":1.681},{"interface":"front","average":{"1min":2.2029999999999998,"5min":2.3180000000000001,"15min":1.9970000000000001},"min":{"1min":1.379,"5min":1.2250000000000001,"15min":1.155},"max":{"1min":5.2850000000000001,"5min":13.894,"15min":13.894},"last":1.7769999999999999}]}]},{"osd":0,"up_from":18,"seq":77309411639,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317680,"kb_used_data":37160,"kb_used_omap":0,"kb_used_meta":280512,"kb_avail":94054160,"statfs":{"total":96636764160,"available":96311459840,"internally_reserved":0,"allocated":38051840,"data_stored":37887017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":287244288},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.5409999999999999,"15min":1.359},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.1800000000000002,"5min":12.207000000000001,"15min":12.207000000000001},"last":4.2999999999999998},{"interface":"front","average":{"1min":2.032,"5min":1.5760000000000001,"15min":1.369},"min":{"1min":0.69099999999999995,"5min":0.625,"15min":0.57099999999999995},"max":{"1min":6.9859999999999998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":1.008}]},{"osd":2,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.631,"15min":1.4239999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.59999999999999998},"max":{"1min":4.827,"5min":19.777999999999999,"15min":19.777999999999999},"last":2.0670000000000002},{"interface":"front","average":{"1min":2.194,"5min":1.8009999999999999,"15min":1.5800000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":8.1519999999999992,"5min":8.1519999999999992,"15min":8.1519999999999992},"last":1.1220000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":2.6659999999999999,"15min":2.1059999999999999},"min":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.627},"max":{"1min":8.5869999999999997,"5min":21.550999999999998,"15min":28.312000000000001},"last":4.4470000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.71,"15min":1.681},"min":{"1min":0.74399999999999999,"5min":0.66700000000000004,"15min":0.57499999999999996},"max":{"1min":2.8769999999999998,"5min":19.666,"15min":19.666},"last":1.966}]},{"osd":4,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.145,"15min":1.8240000000000001},"min":{"1min":0.82099999999999995,"5min":0.79900000000000004,"15min":0.76100000000000001},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":1.228},{"interface":"front","average":{"1min":1.726,"5min":2.4159999999999999,"15min":1.9970000000000001},"min":{"1min":1.1160000000000001,"5min":0.98499999999999999,"15min":0.91100000000000003},"max":{"1min":3.8260000000000001,"5min":19.378,"15min":19.378},"last":4.585}]},{"osd":5,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":2.597,"15min":2.214},"min":{"1min":1.0660000000000001,"5min":0.99399999999999999,"15min":0.73499999999999999},"max":{"1min":3.766,"5min":19.501000000000001,"15min":19.501000000000001},"last":4.694},{"interface":"front","average":{"1min":1.8340000000000001,"5min":2.2530000000000001,"15min":1.9550000000000001},"min":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.83899999999999997},"max":{"1min":5.3170000000000002,"5min":19.905000000000001,"15min":19.905000000000001},"last":2.1760000000000002}]},{"osd":6,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":3.109,"5min":2.899,"15min":2.3690000000000002},"min":{"1min":1.22,"5min":0.91300000000000003,"15min":0.75900000000000001},"max":{"1min":10.334,"5min":21.288,"15min":21.288},"last":2.5670000000000002},{"interface":"front","average":{"1min":3.8780000000000001,"5min":3.7789999999999999,"15min":2.7629999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":0.82199999999999995},"max":{"1min":10.432,"5min":41.530999999999999,"15min":41.530999999999999},"last":2.597}]},{"osd":7,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":2.7200000000000002,"15min":2.3159999999999998},"min":{"1min":1.325,"5min":1.157,"15min":1.103},"max":{"1min":3.9319999999999999,"5min":21.946000000000002,"15min":21.946000000000002},"last":5.2119999999999997},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.347,"15min":2.137},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":0.879},"max":{"1min":6.0739999999999998,"5min":21.530000000000001,"15min":21.530000000000001},"last":2.2799999999999998}]},{"osd":8,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.9620000000000002,"5min":2.6869999999999998,"15min":2.3239999999999998},"min":{"1min":1.222,"5min":1.018,"15min":1.018},"max":{"1min":11.76,"5min":19.030999999999999,"15min":19.030999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":2.052,"5min":2.847,"15min":2.508},"min":{"1min":1.371,"5min":1.274,"15min":1.2210000000000001},"max":{"1min":4.0350000000000001,"5min":19.600999999999999,"15min":19.600999999999999},"last":4.7610000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":3.109,"15min":2.5939999999999999},"min":{"1min":1.542,"5min":1.2390000000000001,"15min":1.226},"max":{"1min":4.2400000000000002,"5min":19.678999999999998,"15min":19.678999999999998},"last":4.8200000000000003},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.5720000000000001,"15min":2.2869999999999999},"min":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":0.995},"max":{"1min":4.04,"5min":21.41,"15min":21.41},"last":2.4700000000000002}]},{"osd":11,"last update":"Fri Nov 20 11:42:37 2020","interfaces":[{"interface":"back","average":{"1min":2.9359999999999999,"5min":2.8319999999999999,"15min":2.3559999999999999},"min":{"1min":1.3149999999999999,"5min":1.1519999999999999,"15min":1.131},"max":{"1min":8.3979999999999997,"5min":19.155999999999999,"15min":19.155999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.2000000000000002,"5min":3.0819999999999999,"15min":2.6280000000000001},"min":{"1min":1.3640000000000001,"5min":1.3560000000000001,"15min":1.26},"max":{"1min":4.1369999999999996,"5min":19.818000000000001,"15min":19.818000000000001},"last":4.9059999999999997}]}]},{"osd":3,"up_from":18,"seq":77309411639,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":626836,"kb_used_data":107788,"kb_used_omap":0,"kb_used_meta":519040,"kb_avail":93745004,"statfs":{"total":96636764160,"available":95994884096,"internally_reserved":0,"allocated":110374912,"data_stored":110193006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":531496960},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.6970000000000001,"15min":1.5049999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":8.9789999999999992,"15min":9.4689999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6879999999999999,"15min":1.4730000000000001},"min":{"1min":0.69599999999999995,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":3.3479999999999999,"5min":4.6260000000000003,"15min":8.6880000000000006},"last":0.752}]},{"osd":2,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.6479999999999999,"15min":1.486},"min":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2989999999999999,"5min":8.4220000000000006,"15min":8.4220000000000006},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.7390000000000001,"15min":1.593},"min":{"1min":0.89800000000000002,"5min":0.745,"15min":0.58699999999999997},"max":{"1min":2.6040000000000001,"5min":4.7430000000000003,"15min":6.7709999999999999},"last":1.077}]},{"osd":4,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.6519999999999999,"15min":1.4830000000000001},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3180000000000001,"5min":6.1879999999999997,"15min":6.1879999999999997},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.53,"5min":1.9079999999999999,"15min":1.6639999999999999},"min":{"1min":0.94099999999999995,"5min":0.69799999999999995,"15min":0.67200000000000004},"max":{"1min":4.702,"5min":6.9850000000000003,"15min":6.9850000000000003},"last":1.111}]},{"osd":5,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":2.0139999999999998,"15min":1.841},"min":{"1min":1.0009999999999999,"5min":0.81899999999999995,"15min":0.69999999999999996},"max":{"1min":3.238,"5min":7.1509999999999998,"15min":23.041},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.9570000000000001,"15min":1.8380000000000001},"min":{"1min":0.80800000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.407,"5min":6.9619999999999997,"15min":22.581},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.5779999999999998,"5min":2.96,"15min":2.5510000000000002},"min":{"1min":1.04,"5min":0.84699999999999998,"15min":0.69699999999999995},"max":{"1min":18.344999999999999,"5min":23.417000000000002,"15min":67.936999999999998},"last":1.2609999999999999},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.7639999999999998,"15min":2.218},"min":{"1min":1.0669999999999999,"5min":0.86099999999999999,"15min":0.82999999999999996},"max":{"1min":17.199000000000002,"5min":19.280999999999999,"15min":19.280999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.879,"5min":2.246,"15min":1.8939999999999999},"min":{"1min":1.3109999999999999,"5min":1.089,"15min":0.84899999999999998},"max":{"1min":3.056,"5min":7.8310000000000004,"15min":7.8310000000000004},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":2.3290000000000002,"15min":2.0499999999999998},"min":{"1min":1.0860000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.7130000000000001,"5min":10.206,"15min":10.206},"last":1.3779999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":2.2109999999999999,"15min":2.0249999999999999},"min":{"1min":1.141,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.0379999999999998,"5min":8.7629999999999999,"15min":10.893000000000001},"last":1.25},{"interface":"front","average":{"1min":2.1160000000000001,"5min":2.2029999999999998,"15min":2.0550000000000002},"min":{"1min":1.4239999999999999,"5min":1.216,"15min":1.02},"max":{"1min":3.4209999999999998,"5min":4.5060000000000002,"15min":10.787000000000001},"last":1.679}]},{"osd":9,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.5499999999999998,"15min":2.3100000000000001},"min":{"1min":1.3540000000000001,"5min":1.157,"15min":1.081},"max":{"1min":3.556,"5min":6.8920000000000003,"15min":9.0779999999999994},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.927,"5min":2.444,"15min":2.2320000000000002},"min":{"1min":1.3109999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.2639999999999998,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.1819999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":2.4860000000000002,"15min":2.23},"min":{"1min":1.2470000000000001,"5min":1.1499999999999999,"15min":1.1000000000000001},"max":{"1min":3.149,"5min":8.875,"15min":8.875},"last":1.321},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.3650000000000002,"15min":2.085},"min":{"1min":1.2609999999999999,"5min":1.1899999999999999,"15min":1.0569999999999999},"max":{"1min":4.4770000000000003,"5min":7.7089999999999996,"15min":7.7089999999999996},"last":1.454}]},{"osd":11,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.488,"15min":2.2410000000000001},"min":{"1min":1.4379999999999999,"5min":1.2969999999999999,"15min":1.0860000000000001},"max":{"1min":3.4849999999999999,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":1.569},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.4260000000000002,"15min":2.2749999999999999},"min":{"1min":1.4690000000000001,"5min":1.1479999999999999,"15min":1.1459999999999999},"max":{"1min":2.7290000000000001,"5min":6.7889999999999997,"15min":10.993},"last":1.615}]}]},{"osd":4,"up_from":18,"seq":77309411640,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353780,"kb_used_data":74028,"kb_used_omap":0,"kb_used_meta":279744,"kb_avail":94018060,"statfs":{"total":96636764160,"available":96274493440,"internally_reserved":0,"allocated":75804672,"data_stored":75635787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":286457856},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.101,"15min":1.081},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54400000000000004},"max":{"1min":3.3500000000000001,"5min":4.0090000000000003,"15min":4.7480000000000002},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7569999999999997,"5min":5.734,"15min":10.750999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.139,"15min":1.171},"min":{"1min":0.63700000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.5800000000000001,"5min":4.1749999999999998,"15min":5.4240000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.3009999999999999,"15min":1.3600000000000001},"min":{"1min":0.75,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.518,"5min":5.4379999999999997,"15min":6.8659999999999997},"last":1.2709999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.5620000000000001,"15min":1.3280000000000001},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.0039999999999996,"5min":28.899999999999999,"15min":28.899999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.746,"5min":1.9279999999999999,"15min":1.6279999999999999},"min":{"1min":0.80100000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.173,"5min":28.882000000000001,"15min":28.882000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.4470000000000001,"15min":1.343},"min":{"1min":0.65500000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.8439999999999999,"5min":6.1589999999999998,"15min":6.1760000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.631,"5min":1.3240000000000001,"15min":1.2949999999999999},"min":{"1min":0.78600000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":6.5129999999999999,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":1.8560000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":2.0030000000000001,"15min":1.6200000000000001},"min":{"1min":0.86899999999999999,"5min":0.73099999999999998,"15min":0.67800000000000005},"max":{"1min":2.621,"5min":18.018000000000001,"15min":18.018000000000001},"last":1.738},{"interface":"front","average":{"1min":1.5649999999999999,"5min":2.2570000000000001,"15min":1.835},"min":{"1min":0.874,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":4.3140000000000001,"5min":18.004000000000001,"15min":18.004000000000001},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5,"15min":1.5309999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.6309999999999998,"5min":6.2300000000000004,"15min":6.7400000000000002},"last":1.415},{"interface":"front","average":{"1min":1.782,"5min":1.528,"15min":1.4890000000000001},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":6.2809999999999997,"5min":6.2809999999999997,"15min":7.6699999999999999},"last":1.046}]},{"osd":8,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.5640000000000001,"15min":1.603},"min":{"1min":0.89100000000000001,"5min":0.79800000000000004,"15min":0.76100000000000001},"max":{"1min":4.319,"5min":4.319,"15min":6.2560000000000002},"last":5.4260000000000002},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.7210000000000001,"15min":1.7589999999999999},"min":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.532,"5min":6.3710000000000004,"15min":10.625999999999999},"last":1.544}]},{"osd":9,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":1.7749999999999999,"15min":1.7589999999999999},"min":{"1min":1.0269999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":6.4480000000000004},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.593,"5min":1.8620000000000001,"15min":1.8779999999999999},"min":{"1min":1.0620000000000001,"5min":0.99399999999999999,"15min":0.90800000000000003},"max":{"1min":2.806,"5min":6.5449999999999999,"15min":6.6310000000000002},"last":1.6679999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.6499999999999999,"15min":1.651},"min":{"1min":1.1240000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":1.9239999999999999},{"interface":"front","average":{"1min":1.9099999999999999,"5min":1.8180000000000001,"15min":1.796},"min":{"1min":1.1539999999999999,"5min":1.0860000000000001,"15min":1.0349999999999999},"max":{"1min":4.8170000000000002,"5min":7.9329999999999998,"15min":7.9329999999999998},"last":1.8200000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.8300000000000001,"15min":1.845},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.9279999999999999,"5min":6.4829999999999997,"15min":6.6210000000000004},"last":1.794},{"interface":"front","average":{"1min":1.794,"5min":1.694,"15min":1.675},"min":{"1min":1.1399999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":6.4009999999999998,"5min":6.4009999999999998,"15min":6.4009999999999998},"last":2.403}]}]},{"osd":5,"up_from":18,"seq":77309411640,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458436,"kb_used_data":38140,"kb_used_omap":0,"kb_used_meta":420288,"kb_avail":93913404,"statfs":{"total":96636764160,"available":96167325696,"internally_reserved":0,"allocated":39055360,"data_stored":38889103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":430374912},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.268,"15min":1.861},"min":{"1min":0.61899999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.2300000000000004,"5min":12.923,"15min":173.643},"last":0.751},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3520000000000001,"15min":2.0670000000000002},"min":{"1min":0.64800000000000002,"5min":0.63,"15min":0.56299999999999994},"max":{"1min":5.6470000000000002,"5min":10.327999999999999,"15min":173.71899999999999},"last":1.002}]},{"osd":1,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4159999999999999,"15min":1.3},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.51800000000000002},"max":{"1min":3.113,"5min":13.898999999999999,"15min":13.898999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.401,"5min":1.4990000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59099999999999997},"max":{"1min":4.3680000000000003,"5min":10.234,"15min":10.234},"last":1.069}]},{"osd":2,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.66200000000000003,"5min":0.57899999999999996,"15min":0.54500000000000004},"max":{"1min":5.7720000000000002,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.484,"5min":1.5149999999999999,"15min":1.3580000000000001},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.55800000000000005},"max":{"1min":4.1920000000000002,"5min":10.614000000000001,"15min":10.614000000000001},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4690000000000001,"15min":1.454},"min":{"1min":0.95599999999999996,"5min":0.623,"15min":0.623},"max":{"1min":3.3610000000000002,"5min":10.728,"15min":10.728},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.532,"15min":1.544},"min":{"1min":0.83499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.8899999999999997,"5min":10.449999999999999,"15min":10.449999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.1379999999999999,"15min":1.821},"min":{"1min":1.1000000000000001,"5min":0.93300000000000005,"15min":0.70999999999999996},"max":{"1min":7.7080000000000002,"5min":13.782,"15min":13.782},"last":1.306},{"interface":"front","average":{"1min":1.8680000000000001,"5min":2.3730000000000002,"15min":1.9850000000000001},"min":{"1min":0.98699999999999999,"5min":0.89200000000000002,"15min":0.64900000000000002},"max":{"1min":7.633,"5min":20.225999999999999,"15min":20.225999999999999},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.8169999999999999,"15min":1.786},"min":{"1min":1.04,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":6.3090000000000002,"5min":10.957000000000001,"15min":11.082000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.97,"5min":1.8899999999999999,"15min":1.8520000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.0329999999999999},"max":{"1min":6.0199999999999996,"5min":11.054,"15min":11.054},"last":1.4390000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":2.0960000000000001,"15min":1.972},"min":{"1min":1.224,"5min":1.089,"15min":1.0449999999999999},"max":{"1min":5.1589999999999998,"5min":18.199000000000002,"15min":18.199000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.895,"15min":1.7350000000000001},"min":{"1min":0.99199999999999999,"5min":0.95699999999999996,"15min":0.76000000000000001},"max":{"1min":5.2149999999999999,"5min":13.041,"15min":13.041},"last":1.335}]},{"osd":9,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.3359999999999999,"15min":1.994},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.86099999999999999},"max":{"1min":11.369,"5min":13.15,"15min":13.15},"last":2.3290000000000002},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1259999999999999,"15min":2.0030000000000001},"min":{"1min":1.256,"5min":1.1890000000000001,"15min":0.92000000000000004},"max":{"1min":6.6820000000000004,"5min":10.837,"15min":10.837},"last":1.3660000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.99,"15min":1.988},"min":{"1min":1.1699999999999999,"5min":1.139,"15min":1.071},"max":{"1min":6.1820000000000004,"5min":16.297999999999998,"15min":16.297999999999998},"last":1.4910000000000001},{"interface":"front","average":{"1min":2.1200000000000001,"5min":2.016,"15min":2.0129999999999999},"min":{"1min":1.323,"5min":1.2410000000000001,"15min":1.24},"max":{"1min":5.0780000000000003,"5min":10.949999999999999,"15min":10.949999999999999},"last":1.6850000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":2.3780000000000001,"15min":2.073},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":0.96599999999999997},"max":{"1min":11.234999999999999,"5min":13.420999999999999,"15min":13.420999999999999},"last":1.468},{"interface":"front","average":{"1min":1.974,"5min":2.516,"15min":2.282},"min":{"1min":1.417,"5min":1.2949999999999999,"15min":1.101},"max":{"1min":4.2599999999999998,"5min":19.321999999999999,"15min":19.321999999999999},"last":1.8049999999999999}]}]},{"osd":6,"up_from":18,"seq":77309411639,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":494948,"kb_used_data":85084,"kb_used_omap":0,"kb_used_meta":409856,"kb_avail":93876892,"statfs":{"total":96636764160,"available":96129937408,"internally_reserved":0,"allocated":87126016,"data_stored":86950416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":419692544},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.885,"15min":1.591},"min":{"1min":0.68700000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":9.7620000000000005,"5min":12.869999999999999,"15min":12.869999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.982,"5min":2.0550000000000002,"15min":1.6339999999999999},"min":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":8.7110000000000003,"5min":19.547999999999998,"15min":19.547999999999998},"last":2.9980000000000002}]},{"osd":1,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":2.0310000000000001,"15min":1.635},"min":{"1min":0.71299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":27.954999999999998,"5min":27.954999999999998,"15min":27.954999999999998},"last":3.8919999999999999},{"interface":"front","average":{"1min":1.8109999999999999,"5min":2.254,"15min":1.78},"min":{"1min":1.0049999999999999,"5min":0.73499999999999999,"15min":0.57099999999999995},"max":{"1min":9.3130000000000006,"5min":16.134,"15min":16.134},"last":1.9910000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":2.0049999999999999,"15min":1.6479999999999999},"min":{"1min":0.70299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":8.8789999999999996,"5min":15.946,"15min":15.946},"last":2.6859999999999999},{"interface":"front","average":{"1min":3.3559999999999999,"5min":2.2839999999999998,"15min":1.835},"min":{"1min":0.70099999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":28.532,"5min":28.532,"15min":28.532},"last":4.0199999999999996}]},{"osd":3,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.7170000000000001,"5min":2.8199999999999998,"15min":2.4750000000000001},"min":{"1min":0.77800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":19.510999999999999,"5min":19.510999999999999,"15min":96.781999999999996},"last":2.7669999999999999},{"interface":"front","average":{"1min":2.786,"5min":2.6190000000000002,"15min":2.464},"min":{"1min":0.91000000000000003,"5min":0.76400000000000001,"15min":0.69299999999999995},"max":{"1min":16.683,"5min":16.683,"15min":96.558999999999997},"last":3.129}]},{"osd":4,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":3.823,"5min":2.8650000000000002,"15min":2.2400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":28.073,"5min":28.484999999999999,"15min":28.484999999999999},"last":4.3319999999999999},{"interface":"front","average":{"1min":2.379,"5min":2.4870000000000001,"15min":2.0910000000000002},"min":{"1min":1.0169999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":9.6899999999999995,"5min":16.672000000000001,"15min":16.672000000000001},"last":3.6360000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":3.7360000000000002,"5min":2.9409999999999998,"15min":2.3759999999999999},"min":{"1min":1.016,"5min":0.874,"15min":0.85399999999999998},"max":{"1min":28.414999999999999,"5min":28.622,"15min":28.622},"last":4.4589999999999996},{"interface":"front","average":{"1min":3.1930000000000001,"5min":2.7669999999999999,"15min":2.2450000000000001},"min":{"1min":1.304,"5min":0.88700000000000001,"15min":0.83799999999999997},"max":{"1min":19.669,"5min":19.669,"15min":19.669},"last":2.1200000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.2270000000000003,"5min":3.2189999999999999,"15min":2.4649999999999999},"min":{"1min":1.413,"5min":1.0409999999999999,"15min":0.996},"max":{"1min":30.012,"5min":30.012,"15min":30.012},"last":4.8490000000000002},{"interface":"front","average":{"1min":3.0089999999999999,"5min":2.879,"15min":2.2799999999999998},"min":{"1min":1.1419999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":16.491,"5min":16.712,"15min":16.712},"last":2.23}]},{"osd":8,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.7670000000000003,"5min":3.427,"15min":2.589},"min":{"1min":1.2949999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":28.295999999999999,"5min":28.960000000000001,"15min":28.960000000000001},"last":4.7599999999999998},{"interface":"front","average":{"1min":4.2430000000000003,"5min":3.1259999999999999,"15min":2.4239999999999999},"min":{"1min":1.4350000000000001,"5min":1.04,"15min":1.04},"max":{"1min":19.800000000000001,"5min":19.800000000000001,"15min":19.800000000000001},"last":2.3260000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":2.8279999999999998,"15min":2.2949999999999999},"min":{"1min":1.1279999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":9.8089999999999993,"5min":16.420000000000002,"15min":16.420000000000002},"last":3.7490000000000001},{"interface":"front","average":{"1min":4.8780000000000001,"5min":3.46,"15min":2.7280000000000002},"min":{"1min":1.2070000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":28.178999999999998,"5min":28.882999999999999,"15min":28.882999999999999},"last":4.9429999999999996}]},{"osd":11,"last update":"Fri Nov 20 11:42:48 2020","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":3.4689999999999999,"15min":2.633},"min":{"1min":1.5589999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":19.920999999999999,"5min":19.920999999999999,"15min":19.920999999999999},"last":2.4220000000000002},{"interface":"front","average":{"1min":3.548,"5min":2.9630000000000001,"15min":2.4129999999999998},"min":{"1min":1.266,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":16.553000000000001,"5min":16.553000000000001,"15min":16.553000000000001},"last":3.8580000000000001}]}]}]}} 2020-11-20T11:43:41.830 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.830 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.831 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.831 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.832 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.832 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.832 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.833 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.833 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.833 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.834 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.834 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T11:17:46.208466+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.834 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.835 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.835 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.835 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.835 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.836 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.836 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.836 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.837 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.837 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.837 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.838 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T11:17:55.578520+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=55, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.838 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-11-20T11:17:58.699708+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=17, tm_sec=58, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:43:41.838 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T11:44:01.840 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:44:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.966+0000 7f5c0fc35700 1 Processor -- start 2020-11-20T11:44:01.969 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.966+0000 7f5c0fc35700 1 -- start start 2020-11-20T11:44:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0fc35700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c08064b90 0x7f5c08064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0fc35700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0814d8a0 con 0x7f5c0814a870 2020-11-20T11:44:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0fc35700 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c08151110 con 0x7f5c08060f10 2020-11-20T11:44:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0fc35700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c081513b0 con 0x7f5c08064b90 2020-11-20T11:44:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0d9d1700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c08064b90 0x7f5c08064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0d9d1700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c08064b90 0x7f5c08064f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.112:37548/0 (socket says 172.21.15.112:37548) 2020-11-20T11:44:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0e1d2700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f5c0814a870 0x7f5c0814dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.112:46620/0 (socket says 172.21.15.112:46620) 2020-11-20T11:44:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.967+0000 7f5c0d9d1700 1 -- 172.21.15.112:0/2077291680 learned_addr learned my addr 172.21.15.112:0/2077291680 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:44:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0c9cf700 1 -- 172.21.15.112:0/2077291680 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110990670 0 0) 0x7f5c0814d8a0 con 0x7f5c0814a870 2020-11-20T11:44:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0d9d1700 1 -- 172.21.15.112:0/2077291680 >> v1:172.21.15.204:6789/0 conn(0x7f5c08060f10 legacy=0x7f5c080bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0d9d1700 1 -- 172.21.15.112:0/2077291680 >> v1:172.21.15.166:6789/0 conn(0x7f5c0814a870 legacy=0x7f5c0814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0d9d1700 1 -- 172.21.15.112:0/2077291680 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08151650 con 0x7f5c08064b90 2020-11-20T11:44:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0d9d1700 1 --2- 172.21.15.112:0/2077291680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c08064b90 0x7f5c08064f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5c04009990 tx=0x7f5c04006ef0).ready entity=mon.2 client_cookie=8d1ad1a9030c7222 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0c9cf700 1 -- 172.21.15.112:0/2077291680 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400b7e0 con 0x7f5c08064b90 2020-11-20T11:44:01.974 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0c9cf700 1 -- 172.21.15.112:0/2077291680 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c04000e90 con 0x7f5c08064b90 2020-11-20T11:44:01.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0c9cf700 1 -- 172.21.15.112:0/2077291680 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400bb50 con 0x7f5c08064b90 2020-11-20T11:44:01.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 -- 172.21.15.112:0/2077291680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c08064b90 msgr2=0x7f5c08064f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:01.977 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/2077291680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c08064b90 0x7f5c08064f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5c04009990 tx=0x7f5c04006ef0).stop 2020-11-20T11:44:01.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 -- 172.21.15.112:0/2077291680 shutdown_connections 2020-11-20T11:44:01.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/2077291680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c08064b90 0x7f5c08064f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:01.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 -- 172.21.15.112:0/2077291680 >> 172.21.15.112:0/2077291680 conn(0x7f5c0805bac0 msgr2=0x7f5c0805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:01.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.968+0000 7f5c0fc35700 1 -- 172.21.15.112:0/2077291680 shutdown_connections 2020-11-20T11:44:01.978 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.969+0000 7f5c0fc35700 1 -- 172.21.15.112:0/2077291680 wait complete. 2020-11-20T11:44:01.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 Processor -- start 2020-11-20T11:44:01.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 -- start start 2020-11-20T11:44:01.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5c08060f10 0x7f5c080c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:01.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:01.979 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c0814a870 0x7f5c08150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080c2b80 con 0x7f5c08064b90 2020-11-20T11:44:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080c26e0 con 0x7f5c08060f10 2020-11-20T11:44:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0fc35700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080c28e0 con 0x7f5c0814a870 2020-11-20T11:44:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.970+0000 7f5c0d1d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51778/0 (socket says 172.21.15.112:51778) 2020-11-20T11:44:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 -- 172.21.15.112:0/1343959536 learned_addr learned my addr 172.21.15.112:0/1343959536 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:44:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d9d1700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5c08060f10 0x7f5c080c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0e1d2700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c0814a870 0x7f5c08150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 -- 172.21.15.112:0/1343959536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c0814a870 msgr2=0x7f5c08150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:01.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c0814a870 0x7f5c08150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:01.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 -- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5c08060f10 msgr2=0x7f5c080c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:01.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5c08060f10 0x7f5c080c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:01.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 -- 172.21.15.112:0/1343959536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0815a3a0 con 0x7f5c08064b90 2020-11-20T11:44:01.982 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0d1d0700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5bf800c7c0 tx=0x7f5bf8007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:01.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8010510 con 0x7f5c08064b90 2020-11-20T11:44:01.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf8010670 con 0x7f5c08064b90 2020-11-20T11:44:01.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0815a640 con 0x7f5c08064b90 2020-11-20T11:44:01.983 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8010a30 con 0x7f5c08064b90 2020-11-20T11:44:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.971+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0815ab80 con 0x7f5c08064b90 2020-11-20T11:44:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.972+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c08063140 con 0x7f5c08064b90 2020-11-20T11:44:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.973+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5bf8010070 con 0x7f5c08064b90 2020-11-20T11:44:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.973+0000 7f5bf5ffb700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 0x7f5be0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.973+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5bf80a21f0 con 0x7f5c08064b90 2020-11-20T11:44:01.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.974+0000 7f5c0d9d1700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 0x7f5be0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:01.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.974+0000 7f5c0d9d1700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 0x7f5be0082b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5c04006f30 tx=0x7f5c04015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:01.985 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:01.977+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5bf8076ba0 con 0x7f5c08064b90 2020-11-20T11:44:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.115+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c0815ad10 con 0x7f5be0080670 2020-11-20T11:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.121+0000 7f5bf5ffb700 1 -- 172.21.15.112:0/1343959536 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149752 (secure 0 0 0) 0x7f5c0815ad10 con 0x7f5be0080670 2020-11-20T11:44:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:44:02.127 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 msgr2=0x7f5be0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:02.127 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 0x7f5be0082b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5c04006f30 tx=0x7f5c04015000).stop 2020-11-20T11:44:02.127 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 msgr2=0x7f5c0814f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:02.128 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5bf800c7c0 tx=0x7f5bf8007bf0).stop 2020-11-20T11:44:02.128 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 shutdown_connections 2020-11-20T11:44:02.128 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5be0080670 0x7f5be0082b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:02.128 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c0814a870 0x7f5c08150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:02.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5c08060f10 0x7f5c080c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:02.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 --2- 172.21.15.112:0/1343959536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08064b90 0x7f5c0814f7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:02.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 >> 172.21.15.112:0/1343959536 conn(0x7f5c0805bac0 msgr2=0x7f5c08060400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:02.129 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 shutdown_connections 2020-11-20T11:44:02.130 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:02.123+0000 7f5c0fc35700 1 -- 172.21.15.112:0/1343959536 wait complete. 2020-11-20T11:44:02.130 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:44:02.137 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":804,"stamp":"2020-11-20T11:44:00.401768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":251393224,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":19623,"num_read_kb":1133421,"num_write":314277,"num_write_kb":6512178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600901,"num_omap_keys":953,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160903,"ondisk_log_size":160903,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3932024,"kb_used_data":494616,"kb_used_omap":0,"kb_used_meta":3437312,"kb_avail":1128530056,"statfs":{"total":1159641169920,"available":1155614777344,"internally_reserved":0,"allocated":506486784,"data_stored":504445820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3519807488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":181468,"num_omap_keys":292,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002948"},"pg_stats":[{"pgid":"4.2","version":"29'27790","reported_seq":"28995","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:47.183857+0000","last_change":"2020-11-20T11:43:47.183974+0000","last_active":"2020-11-20T11:43:47.183857+0000","last_peered":"2020-11-20T11:43:47.183857+0000","last_clean":"2020-11-20T11:43:47.183857+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:43:47.183857+0000","last_undegraded":"2020-11-20T11:43:47.183857+0000","last_fullsized":"2020-11-20T11:43:47.183857+0000","mapping_epoch":27,"log_start":"29'17744","ondisk_log_start":"29'17744","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27790","last_scrub_stamp":"2020-11-20T11:43:47.183851+0000","last_deep_scrub":"29'27790","last_deep_scrub_stamp":"2020-11-20T11:43:47.183851+0000","last_clean_scrub_stamp":"2020-11-20T11:43:47.183851+0000","log_size":10046,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1191,"num_read_kb":78290,"num_write":20463,"num_write_kb":728019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:38.529349+0000","last_change":"2020-11-20T11:43:38.529440+0000","last_active":"2020-11-20T11:43:38.529349+0000","last_peered":"2020-11-20T11:43:38.529349+0000","last_clean":"2020-11-20T11:43:38.529349+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:43:38.529349+0000","last_undegraded":"2020-11-20T11:43:38.529349+0000","last_fullsized":"2020-11-20T11:43:38.529349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:38.529344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:38.529344+0000","last_clean_scrub_stamp":"2020-11-20T11:43:38.529344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'23449","reported_seq":"23463","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:44.663275+0000","last_change":"2020-11-20T11:43:44.663337+0000","last_active":"2020-11-20T11:43:44.663275+0000","last_peered":"2020-11-20T11:43:44.663275+0000","last_clean":"2020-11-20T11:43:44.663275+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:43:44.663275+0000","last_undegraded":"2020-11-20T11:43:44.663275+0000","last_fullsized":"2020-11-20T11:43:44.663275+0000","mapping_epoch":24,"log_start":"29'13400","ondisk_log_start":"29'13400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23449","last_scrub_stamp":"2020-11-20T11:43:44.663269+0000","last_deep_scrub":"29'23449","last_deep_scrub_stamp":"2020-11-20T11:43:44.663269+0000","last_clean_scrub_stamp":"2020-11-20T11:43:44.663269+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":23462,"num_write_kb":165859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74568,"num_omap_keys":120,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"29'27745","reported_seq":"29901","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:55.532060+0000","last_change":"2020-11-20T11:43:55.532166+0000","last_active":"2020-11-20T11:43:55.532060+0000","last_peered":"2020-11-20T11:43:55.532060+0000","last_clean":"2020-11-20T11:43:55.532060+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:43:55.532060+0000","last_undegraded":"2020-11-20T11:43:55.532060+0000","last_fullsized":"2020-11-20T11:43:55.532060+0000","mapping_epoch":27,"log_start":"29'17730","ondisk_log_start":"29'17730","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27745","last_scrub_stamp":"2020-11-20T11:43:55.532054+0000","last_deep_scrub":"29'27745","last_deep_scrub_stamp":"2020-11-20T11:43:55.532054+0000","last_clean_scrub_stamp":"2020-11-20T11:43:55.532054+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2142,"num_read_kb":148296,"num_write":20457,"num_write_kb":686402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:42.464718+0000","last_change":"2020-11-20T11:43:42.464820+0000","last_active":"2020-11-20T11:43:42.464718+0000","last_peered":"2020-11-20T11:43:42.464718+0000","last_clean":"2020-11-20T11:43:42.464718+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:43:42.464718+0000","last_undegraded":"2020-11-20T11:43:42.464718+0000","last_fullsized":"2020-11-20T11:43:42.464718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:42.464713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:42.464713+0000","last_clean_scrub_stamp":"2020-11-20T11:43:42.464713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'21489","reported_seq":"21503","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:43.765493+0000","last_change":"2020-11-20T11:43:43.765572+0000","last_active":"2020-11-20T11:43:43.765493+0000","last_peered":"2020-11-20T11:43:43.765493+0000","last_clean":"2020-11-20T11:43:43.765493+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:43:43.765493+0000","last_undegraded":"2020-11-20T11:43:43.765493+0000","last_fullsized":"2020-11-20T11:43:43.765493+0000","mapping_epoch":24,"log_start":"29'11400","ondisk_log_start":"29'11400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21489","last_scrub_stamp":"2020-11-20T11:43:43.765488+0000","last_deep_scrub":"29'21489","last_deep_scrub_stamp":"2020-11-20T11:43:43.765488+0000","last_clean_scrub_stamp":"2020-11-20T11:43:43.765488+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943074,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":21508,"num_write_kb":159909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64624,"num_omap_keys":107,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"29'25905","reported_seq":"29318","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:34.164607+0000","last_change":"2020-11-20T11:18:02.983930+0000","last_active":"2020-11-20T11:43:34.164607+0000","last_peered":"2020-11-20T11:43:34.164607+0000","last_clean":"2020-11-20T11:43:34.164607+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:43:34.164607+0000","last_undegraded":"2020-11-20T11:43:34.164607+0000","last_fullsized":"2020-11-20T11:43:34.164607+0000","mapping_epoch":27,"log_start":"29'15875","ondisk_log_start":"29'15875","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:18:01.713630+0000","last_clean_scrub_stamp":"2020-11-20T11:18:01.713630+0000","log_size":10030,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3402,"num_read_kb":211712,"num_write":18641,"num_write_kb":503848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.640177+0000","last_change":"2020-11-20T11:43:40.640237+0000","last_active":"2020-11-20T11:43:40.640177+0000","last_peered":"2020-11-20T11:43:40.640177+0000","last_clean":"2020-11-20T11:43:40.640177+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:43:40.640177+0000","last_undegraded":"2020-11-20T11:43:40.640177+0000","last_fullsized":"2020-11-20T11:43:40.640177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.640173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.640173+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.640173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'18523","reported_seq":"18537","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:42.408599+0000","last_change":"2020-11-20T11:43:42.408682+0000","last_active":"2020-11-20T11:43:42.408599+0000","last_peered":"2020-11-20T11:43:42.408599+0000","last_clean":"2020-11-20T11:43:42.408599+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:43:42.408599+0000","last_undegraded":"2020-11-20T11:43:42.408599+0000","last_fullsized":"2020-11-20T11:43:42.408599+0000","mapping_epoch":24,"log_start":"29'8500","ondisk_log_start":"29'8500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18523","last_scrub_stamp":"2020-11-20T11:43:42.408593+0000","last_deep_scrub":"29'18523","last_deep_scrub_stamp":"2020-11-20T11:43:42.408593+0000","last_clean_scrub_stamp":"2020-11-20T11:43:42.408593+0000","log_size":10023,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":18571,"num_write_kb":134049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71471,"num_omap_keys":115,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"29'26715","reported_seq":"29059","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:50.488921+0000","last_change":"2020-11-20T11:43:50.489019+0000","last_active":"2020-11-20T11:43:50.488921+0000","last_peered":"2020-11-20T11:43:50.488921+0000","last_clean":"2020-11-20T11:43:50.488921+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:43:50.488921+0000","last_undegraded":"2020-11-20T11:43:50.488921+0000","last_fullsized":"2020-11-20T11:43:50.488921+0000","mapping_epoch":27,"log_start":"29'16620","ondisk_log_start":"29'16620","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26715","last_scrub_stamp":"2020-11-20T11:43:50.488915+0000","last_deep_scrub":"29'26715","last_deep_scrub_stamp":"2020-11-20T11:43:50.488915+0000","last_clean_scrub_stamp":"2020-11-20T11:43:50.488915+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":130128,"num_write":19349,"num_write_kb":649312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.673976+0000","last_change":"2020-11-20T11:43:39.674057+0000","last_active":"2020-11-20T11:43:39.673976+0000","last_peered":"2020-11-20T11:43:39.673976+0000","last_clean":"2020-11-20T11:43:39.673976+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:43:39.673976+0000","last_undegraded":"2020-11-20T11:43:39.673976+0000","last_fullsized":"2020-11-20T11:43:39.673976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:39.673970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:39.673970+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.673970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"29'6","reported_seq":"27","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.485225+0000","last_change":"2020-11-20T11:43:39.485296+0000","last_active":"2020-11-20T11:43:39.485225+0000","last_peered":"2020-11-20T11:43:39.485225+0000","last_clean":"2020-11-20T11:43:39.485225+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:43:39.485225+0000","last_undegraded":"2020-11-20T11:43:39.485225+0000","last_fullsized":"2020-11-20T11:43:39.485225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2020-11-20T11:43:39.485215+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2020-11-20T11:43:39.485215+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.485215+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12391,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'22081","reported_seq":"22096","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:38.923178+0000","last_change":"2020-11-20T11:43:38.923178+0000","last_active":"2020-11-20T11:43:38.923178+0000","last_peered":"2020-11-20T11:43:38.923178+0000","last_clean":"2020-11-20T11:43:38.923178+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:43:38.923178+0000","last_undegraded":"2020-11-20T11:43:38.923178+0000","last_fullsized":"2020-11-20T11:43:38.923178+0000","mapping_epoch":24,"log_start":"29'12000","ondisk_log_start":"29'12000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22080","last_scrub_stamp":"2020-11-20T11:43:38.923075+0000","last_deep_scrub":"29'22080","last_deep_scrub_stamp":"2020-11-20T11:43:38.923075+0000","last_clean_scrub_stamp":"2020-11-20T11:43:38.923075+0000","log_size":10081,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26168288,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22090,"num_write_kb":157240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60910,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'27059","reported_seq":"30149","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:53.268425+0000","last_change":"2020-11-20T11:43:53.268517+0000","last_active":"2020-11-20T11:43:53.268425+0000","last_peered":"2020-11-20T11:43:53.268425+0000","last_clean":"2020-11-20T11:43:53.268425+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:43:53.268425+0000","last_undegraded":"2020-11-20T11:43:53.268425+0000","last_fullsized":"2020-11-20T11:43:53.268425+0000","mapping_epoch":27,"log_start":"29'17048","ondisk_log_start":"29'17048","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27059","last_scrub_stamp":"2020-11-20T11:43:53.268418+0000","last_deep_scrub":"29'27059","last_deep_scrub_stamp":"2020-11-20T11:43:53.268418+0000","last_clean_scrub_stamp":"2020-11-20T11:43:53.268418+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3076,"num_read_kb":198434,"num_write":19655,"num_write_kb":812748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.480441+0000","last_change":"2020-11-20T11:43:40.480537+0000","last_active":"2020-11-20T11:43:40.480441+0000","last_peered":"2020-11-20T11:43:40.480441+0000","last_clean":"2020-11-20T11:43:40.480441+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:43:40.480441+0000","last_undegraded":"2020-11-20T11:43:40.480441+0000","last_fullsized":"2020-11-20T11:43:40.480441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.480436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.480436+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.480436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15589","reported_seq":"16576","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:45.750592+0000","last_change":"2020-11-20T11:43:45.750680+0000","last_active":"2020-11-20T11:43:45.750592+0000","last_peered":"2020-11-20T11:43:45.750592+0000","last_clean":"2020-11-20T11:43:45.750592+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:43:45.750592+0000","last_undegraded":"2020-11-20T11:43:45.750592+0000","last_fullsized":"2020-11-20T11:43:45.750592+0000","mapping_epoch":24,"log_start":"29'5500","ondisk_log_start":"29'5500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15589","last_scrub_stamp":"2020-11-20T11:43:45.750584+0000","last_deep_scrub":"29'15589","last_deep_scrub_stamp":"2020-11-20T11:43:45.750584+0000","last_clean_scrub_stamp":"2020-11-20T11:43:45.750584+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":4817,"num_write":15600,"num_write_kb":119720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22994,"num_omap_keys":37,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'26836","reported_seq":"28275","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:41.760121+0000","last_change":"2020-11-20T11:43:41.760218+0000","last_active":"2020-11-20T11:43:41.760121+0000","last_peered":"2020-11-20T11:43:41.760121+0000","last_clean":"2020-11-20T11:43:41.760121+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:43:41.760121+0000","last_undegraded":"2020-11-20T11:43:41.760121+0000","last_fullsized":"2020-11-20T11:43:41.760121+0000","mapping_epoch":27,"log_start":"29'16815","ondisk_log_start":"29'16815","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26836","last_scrub_stamp":"2020-11-20T11:43:41.760115+0000","last_deep_scrub":"29'26836","last_deep_scrub_stamp":"2020-11-20T11:43:41.760115+0000","last_clean_scrub_stamp":"2020-11-20T11:43:41.760115+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1425,"num_read_kb":95802,"num_write":19396,"num_write_kb":604990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:45.130079+0000","last_change":"2020-11-20T11:43:45.130180+0000","last_active":"2020-11-20T11:43:45.130079+0000","last_peered":"2020-11-20T11:43:45.130079+0000","last_clean":"2020-11-20T11:43:45.130079+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:43:45.130079+0000","last_undegraded":"2020-11-20T11:43:45.130079+0000","last_fullsized":"2020-11-20T11:43:45.130079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:45.130072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:45.130072+0000","last_clean_scrub_stamp":"2020-11-20T11:43:45.130072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'21577","reported_seq":"22100","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:50.716775+0000","last_change":"2020-11-20T11:43:50.716836+0000","last_active":"2020-11-20T11:43:50.716775+0000","last_peered":"2020-11-20T11:43:50.716775+0000","last_clean":"2020-11-20T11:43:50.716775+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:43:50.716775+0000","last_undegraded":"2020-11-20T11:43:50.716775+0000","last_fullsized":"2020-11-20T11:43:50.716775+0000","mapping_epoch":24,"log_start":"29'11500","ondisk_log_start":"29'11500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21577","last_scrub_stamp":"2020-11-20T11:43:50.716769+0000","last_deep_scrub":"29'21577","last_deep_scrub_stamp":"2020-11-20T11:43:50.716769+0000","last_clean_scrub_stamp":"2020-11-20T11:43:50.716769+0000","log_size":10077,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53257703,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":512,"num_read_kb":3197,"num_write":21592,"num_write_kb":163023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59659,"num_omap_keys":96,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"29'27800","reported_seq":"30322","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:55.119644+0000","last_change":"2020-11-20T11:43:55.119742+0000","last_active":"2020-11-20T11:43:55.119644+0000","last_peered":"2020-11-20T11:43:55.119644+0000","last_clean":"2020-11-20T11:43:55.119644+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:43:55.119644+0000","last_undegraded":"2020-11-20T11:43:55.119644+0000","last_fullsized":"2020-11-20T11:43:55.119644+0000","mapping_epoch":27,"log_start":"29'17742","ondisk_log_start":"29'17742","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27800","last_scrub_stamp":"2020-11-20T11:43:55.119638+0000","last_deep_scrub":"29'27800","last_deep_scrub_stamp":"2020-11-20T11:43:55.119638+0000","last_clean_scrub_stamp":"2020-11-20T11:43:55.119638+0000","log_size":10058,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2508,"num_read_kb":194578,"num_write":20501,"num_write_kb":678922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'12672","reported_seq":"13406","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:51.144034+0000","last_change":"2020-11-20T11:43:51.144096+0000","last_active":"2020-11-20T11:43:51.144034+0000","last_peered":"2020-11-20T11:43:51.144034+0000","last_clean":"2020-11-20T11:43:51.144034+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:43:51.144034+0000","last_undegraded":"2020-11-20T11:43:51.144034+0000","last_fullsized":"2020-11-20T11:43:51.144034+0000","mapping_epoch":24,"log_start":"29'2600","ondisk_log_start":"29'2600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12672","last_scrub_stamp":"2020-11-20T11:43:51.144028+0000","last_deep_scrub":"29'12672","last_deep_scrub_stamp":"2020-11-20T11:43:51.144028+0000","last_clean_scrub_stamp":"2020-11-20T11:43:51.144028+0000","log_size":10072,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20972095,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":722,"num_read_kb":4571,"num_write":12694,"num_write_kb":97715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121809,"num_omap_keys":196,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.535833+0000","last_change":"2020-11-20T11:43:39.535915+0000","last_active":"2020-11-20T11:43:39.535833+0000","last_peered":"2020-11-20T11:43:39.535833+0000","last_clean":"2020-11-20T11:43:39.535833+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:43:39.535833+0000","last_undegraded":"2020-11-20T11:43:39.535833+0000","last_fullsized":"2020-11-20T11:43:39.535833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:39.535828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:39.535828+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.535828+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"29'27006","reported_seq":"28346","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:41.102277+0000","last_change":"2020-11-20T11:43:41.102398+0000","last_active":"2020-11-20T11:43:41.102277+0000","last_peered":"2020-11-20T11:43:41.102277+0000","last_clean":"2020-11-20T11:43:41.102277+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:43:41.102277+0000","last_undegraded":"2020-11-20T11:43:41.102277+0000","last_fullsized":"2020-11-20T11:43:41.102277+0000","mapping_epoch":27,"log_start":"29'16957","ondisk_log_start":"29'16957","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27006","last_scrub_stamp":"2020-11-20T11:43:41.102270+0000","last_deep_scrub":"29'27006","last_deep_scrub_stamp":"2020-11-20T11:43:41.102270+0000","last_clean_scrub_stamp":"2020-11-20T11:43:41.102270+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1326,"num_read_kb":63596,"num_write":19698,"num_write_kb":703697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.640884+0000","last_change":"2020-11-20T11:43:40.640965+0000","last_active":"2020-11-20T11:43:40.640884+0000","last_peered":"2020-11-20T11:43:40.640884+0000","last_clean":"2020-11-20T11:43:40.640884+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:43:40.640884+0000","last_undegraded":"2020-11-20T11:43:40.640884+0000","last_fullsized":"2020-11-20T11:43:40.640884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.640872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.640872+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.640872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'19992","reported_seq":"20006","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.192700+0000","last_change":"2020-11-20T11:43:39.192755+0000","last_active":"2020-11-20T11:43:39.192700+0000","last_peered":"2020-11-20T11:43:39.192700+0000","last_clean":"2020-11-20T11:43:39.192700+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:43:39.192700+0000","last_undegraded":"2020-11-20T11:43:39.192700+0000","last_fullsized":"2020-11-20T11:43:39.192700+0000","mapping_epoch":24,"log_start":"29'9900","ondisk_log_start":"29'9900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19992","last_scrub_stamp":"2020-11-20T11:43:39.192696+0000","last_deep_scrub":"29'19992","last_deep_scrub_stamp":"2020-11-20T11:43:39.192696+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.192696+0000","log_size":10092,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":20597,"num_write_kb":146710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112475,"num_omap_keys":181,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17400,"num_read_kb":1120836,"num_write":158160,"num_write_kb":5367938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80325,"ondisk_log_size":80325,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":251393224,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":2223,"num_read_kb":12585,"num_write":156114,"num_write_kb":1144225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588510,"num_omap_keys":950,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":502849536,"data_stored":502786448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80572,"ondisk_log_size":80572,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12391,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411644,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109424,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":109120,"kb_avail":94262416,"statfs":{"total":96636764160,"available":96524713984,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111738880},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.6930000000000001,"15min":1.2769999999999999},"min":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":60.896000000000001,"15min":60.896000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.8120000000000001,"15min":1.351},"min":{"1min":0.63100000000000001,"5min":0.57199999999999995,"15min":0.56899999999999995},"max":{"1min":2.5950000000000002,"5min":64.224000000000004,"15min":64.224000000000004},"last":1.2569999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.68999999999999995,"5min":0.59299999999999997,"15min":0.56999999999999995},"max":{"1min":3.536,"5min":5.4260000000000002,"15min":11.624000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.25,"15min":1.2669999999999999},"min":{"1min":0.79100000000000004,"5min":0.59999999999999998,"15min":0.46600000000000003},"max":{"1min":1.5209999999999999,"5min":6.2240000000000002,"15min":6.375},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.464,"15min":1.278},"min":{"1min":0.66500000000000004,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":4.9950000000000001,"5min":9.5730000000000004,"15min":11.711},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.341,"5min":1.506,"15min":1.3999999999999999},"min":{"1min":0.79400000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.4079999999999999,"5min":9.5120000000000005,"15min":10.047000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.708,"5min":2.177,"15min":1.833},"min":{"1min":0.79700000000000004,"5min":0.75,"15min":0.61899999999999999},"max":{"1min":6.2400000000000002,"5min":41.573999999999998,"15min":41.573999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.575,"5min":2.1160000000000001,"15min":1.6870000000000001},"min":{"1min":0.83799999999999997,"5min":0.79100000000000004,"15min":0.60299999999999998},"max":{"1min":3.7810000000000001,"5min":46.341999999999999,"15min":46.341999999999999},"last":1.3029999999999999}]},{"osd":4,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.512,"15min":1.46},"min":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.626},"max":{"1min":3.5409999999999999,"5min":7.0259999999999998,"15min":7.3819999999999997},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.393,"5min":1.623,"15min":1.651},"min":{"1min":1.0029999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7549999999999999,"5min":9.7059999999999995,"15min":9.7059999999999995},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.8490000000000002,"15min":2.1040000000000001},"min":{"1min":1.0229999999999999,"5min":0.85999999999999999,"15min":0.85699999999999998},"max":{"1min":7.1459999999999999,"5min":22.707999999999998,"15min":22.707999999999998},"last":1.216},{"interface":"front","average":{"1min":2.339,"5min":3.0470000000000002,"15min":2.1560000000000001},"min":{"1min":1.0900000000000001,"5min":0.96199999999999997,"15min":0.76600000000000001},"max":{"1min":5.6559999999999997,"5min":21.841999999999999,"15min":21.841999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.7669999999999999,"15min":1.8220000000000001},"min":{"1min":1.1539999999999999,"5min":0.97399999999999998,"15min":0.88300000000000001},"max":{"1min":4.298,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.413},{"interface":"front","average":{"1min":1.742,"5min":1.8819999999999999,"15min":1.788},"min":{"1min":1.1060000000000001,"5min":0.96299999999999997,"15min":0.72199999999999998},"max":{"1min":3.907,"5min":6.5750000000000002,"15min":12.638999999999999},"last":1.1279999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.9239999999999999,"15min":1.8280000000000001},"min":{"1min":1.1699999999999999,"5min":1.0229999999999999,"15min":0.99299999999999999},"max":{"1min":3.9079999999999999,"5min":7.1470000000000002,"15min":9.8529999999999998},"last":1.286},{"interface":"front","average":{"1min":1.798,"5min":1.919,"15min":1.9450000000000001},"min":{"1min":1.226,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.8980000000000001,"5min":7.5810000000000004,"15min":10.669},"last":1.6899999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":2.056,"15min":1.8779999999999999},"min":{"1min":1.258,"5min":1.1040000000000001,"15min":1.0680000000000001},"max":{"1min":5.5259999999999998,"5min":7.3390000000000004,"15min":12.757},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.806},"min":{"1min":1.24,"5min":1.105,"15min":0.98099999999999998},"max":{"1min":3.6669999999999998,"5min":7.4139999999999997,"15min":7.8620000000000001},"last":1.4610000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":1.875,"15min":1.8959999999999999},"min":{"1min":1.2889999999999999,"5min":1.109,"15min":1.0760000000000001},"max":{"1min":5.6420000000000003,"5min":7.8179999999999996,"15min":7.8179999999999996},"last":1.8149999999999999},{"interface":"front","average":{"1min":2.0009999999999999,"5min":2.2080000000000002,"15min":2.0249999999999999},"min":{"1min":1.3280000000000001,"5min":1.099,"15min":1.079},"max":{"1min":4.9960000000000004,"5min":7.1849999999999996,"15min":12.827},"last":1.3919999999999999}]}]},{"osd":7,"up_from":18,"seq":77309411644,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192688,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":192384,"kb_avail":94179152,"statfs":{"total":96636764160,"available":96439451648,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":197001216},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2490000000000001,"15min":1.1579999999999999},"min":{"1min":0.58099999999999996,"5min":0.48999999999999999,"15min":0.45400000000000001},"max":{"1min":4.2850000000000001,"5min":5.6310000000000002,"15min":10.59},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.4750000000000001,"15min":1.4039999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.524,"5min":15.769,"15min":27.672999999999998},"last":0.96899999999999997}]},{"osd":1,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.3380000000000001,"15min":1.2110000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2349999999999999,"5min":8.5679999999999996,"15min":8.5679999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.228,"5min":1.575,"15min":1.476},"min":{"1min":0.77000000000000002,"5min":0.63800000000000001,"15min":0.503},"max":{"1min":2.6869999999999998,"5min":8.6850000000000005,"15min":9.0530000000000008},"last":1.1100000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.4710000000000001,"15min":1.4770000000000001},"min":{"1min":0.72799999999999998,"5min":0.62,"15min":0.60199999999999998},"max":{"1min":3.0099999999999998,"5min":7.5899999999999999,"15min":28.530000000000001},"last":1.468},{"interface":"front","average":{"1min":1.238,"5min":1.6359999999999999,"15min":1.4490000000000001},"min":{"1min":0.77300000000000002,"5min":0.65900000000000003,"15min":0.50600000000000001},"max":{"1min":2.109,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":1.3069999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.6990000000000001,"15min":1.5509999999999999},"min":{"1min":0.71999999999999997,"5min":0.65600000000000003,"15min":0.61699999999999999},"max":{"1min":5.5629999999999997,"5min":8.6660000000000004,"15min":8.6660000000000004},"last":1.427},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.7210000000000001,"15min":1.7569999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.68799999999999994},"max":{"1min":3.113,"5min":7.4459999999999997,"15min":27.812000000000001},"last":1.286}]},{"osd":5,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.78,"15min":1.627},"min":{"1min":0.84799999999999998,"5min":0.69299999999999995,"15min":0.67400000000000004},"max":{"1min":3.6930000000000001,"5min":9.0139999999999993,"15min":10.208},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.8149999999999999,"15min":1.633},"min":{"1min":0.85499999999999998,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":2.165,"5min":12.459,"15min":12.459},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.7280000000000002,"15min":2.0049999999999999},"min":{"1min":0.95299999999999996,"5min":0.73199999999999998,"15min":0.69299999999999995},"max":{"1min":12.472,"5min":24.305,"15min":24.305},"last":1.204},{"interface":"front","average":{"1min":2.6600000000000001,"5min":2.9700000000000002,"15min":2.2770000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":0.86899999999999999},"max":{"1min":21.210000000000001,"5min":24.324999999999999,"15min":24.324999999999999},"last":1.331}]},{"osd":8,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.8540000000000001,"15min":1.845},"min":{"1min":1.0369999999999999,"5min":0.93100000000000005,"15min":0.69799999999999995},"max":{"1min":3.2120000000000002,"5min":7.7149999999999999,"15min":28.039999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.679,"5min":2.0249999999999999,"15min":1.8120000000000001},"min":{"1min":1.1759999999999999,"5min":0.92800000000000005,"15min":0.83499999999999996},"max":{"1min":2.8460000000000001,"5min":8.0730000000000004,"15min":8.4949999999999992},"last":1.496}]},{"osd":9,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":2.1840000000000002,"15min":2.2440000000000002},"min":{"1min":1.2290000000000001,"5min":0.92600000000000005,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":8.4589999999999996,"15min":56.667999999999999},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.9610000000000001,"5min":2.1749999999999998,"15min":2.1829999999999998},"min":{"1min":1.214,"5min":1.018,"15min":0.94999999999999996},"max":{"1min":3.7909999999999999,"5min":9.9740000000000002,"15min":55.774000000000001},"last":1.236}]},{"osd":10,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.9530000000000001,"15min":1.9159999999999999},"min":{"1min":1.089,"5min":1.034,"15min":0.71499999999999997},"max":{"1min":3.3130000000000002,"5min":7.835,"15min":27.931999999999999},"last":1.367},{"interface":"front","average":{"1min":1.7330000000000001,"5min":2.0089999999999999,"15min":2.0030000000000001},"min":{"1min":1.2669999999999999,"5min":1.1439999999999999,"15min":0.89000000000000001},"max":{"1min":2.8820000000000001,"5min":7.657,"15min":17.899000000000001},"last":1.5820000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:01 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":2.2290000000000001,"15min":1.9930000000000001},"min":{"1min":1.097,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":3.4860000000000002,"5min":8.8070000000000004,"15min":10.467000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.2669999999999999,"15min":2.1389999999999998},"min":{"1min":1.2230000000000001,"5min":1.147,"15min":0.99299999999999999},"max":{"1min":5.8220000000000001,"5min":8.2260000000000009,"15min":28.638999999999999},"last":1.5549999999999999}]}]},{"osd":1,"up_from":18,"seq":77309411643,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102192,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":101888,"kb_avail":94269648,"statfs":{"total":96636764160,"available":96532119552,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104333312},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.139,"15min":1.0169999999999999},"min":{"1min":0.59599999999999997,"5min":0.56599999999999995,"15min":0.55000000000000004},"max":{"1min":4.8959999999999999,"5min":4.8959999999999999,"15min":6.5350000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.4870000000000001,"15min":1.413},"min":{"1min":0.84599999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":5.0030000000000001,"5min":5.0030000000000001,"15min":6.649},"last":1.212}]},{"osd":2,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.145,"15min":1.323},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.56299999999999994},"max":{"1min":3.2130000000000001,"5min":6.9470000000000001,"15min":29.122},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.0669999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":1.276}]},{"osd":3,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3879999999999999,"15min":1.6899999999999999},"min":{"1min":0.74099999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"max":{"1min":3.3050000000000002,"5min":4.5640000000000001,"15min":69.046000000000006},"last":0.751},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3600000000000001,"15min":1.6839999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.476,"5min":5.0030000000000001,"15min":69.950000000000003},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.361,"15min":1.3620000000000001},"min":{"1min":0.80100000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.4220000000000002,"5min":4.4779999999999998,"15min":6.3419999999999996},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.448,"15min":1.5309999999999999},"min":{"1min":0.92800000000000005,"5min":0.70399999999999996,"15min":0.66600000000000004},"max":{"1min":3.282,"5min":7.1079999999999997,"15min":7.1079999999999997},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.462,"15min":1.496},"min":{"1min":0.70599999999999996,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.9939999999999998,"5min":5.1420000000000003,"15min":9.8879999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.7190000000000001,"5min":1.6200000000000001,"15min":1.5620000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":4.867,"5min":4.867,"15min":5.8700000000000001},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.972,"5min":2.6619999999999999,"15min":2.4049999999999998},"min":{"1min":1.0109999999999999,"5min":0.91700000000000004,"15min":0.84799999999999998},"max":{"1min":5.6669999999999998,"5min":47.176000000000002,"15min":69.305999999999997},"last":1.143},{"interface":"front","average":{"1min":1.617,"5min":2.1070000000000002,"15min":1.9079999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":4.0739999999999998,"5min":19.556000000000001,"15min":19.556000000000001},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.736,"15min":1.72},"min":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.92200000000000004},"max":{"1min":2.4860000000000002,"5min":5.46,"15min":7.5789999999999997},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.7330000000000001,"15min":1.7929999999999999},"min":{"1min":1.105,"5min":0.98299999999999998,"15min":0.92000000000000004},"max":{"1min":3.52,"5min":4.3310000000000004,"15min":7.4699999999999998},"last":1.427}]},{"osd":8,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.7490000000000001,"15min":1.7310000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8959999999999999,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.194},{"interface":"front","average":{"1min":1.724,"5min":1.889,"15min":1.8049999999999999},"min":{"1min":1.1739999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":4.4320000000000004,"5min":5.056,"15min":5.452},"last":1.4750000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":2.516,"15min":2.161},"min":{"1min":1.151,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.411,"5min":47.082000000000001,"15min":47.082000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.4820000000000002,"15min":2.1440000000000001},"min":{"1min":1.091,"5min":1.0720000000000001,"15min":1.028},"max":{"1min":4.2690000000000001,"5min":47.012999999999998,"15min":47.012999999999998},"last":1.5860000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.8360000000000001,"15min":1.847},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":4.516,"5min":5.008,"15min":8.5109999999999992},"last":1.345},{"interface":"front","average":{"1min":1.9279999999999999,"5min":2.677,"15min":2.2050000000000001},"min":{"1min":1.282,"5min":1.2330000000000001,"15min":1.1459999999999999},"max":{"1min":4.5739999999999998,"5min":47.206000000000003,"15min":47.206000000000003},"last":1.5489999999999999}]}]},{"osd":11,"up_from":18,"seq":77309411644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241912,"kb_used_data":20784,"kb_used_omap":0,"kb_used_meta":221120,"kb_avail":94129928,"statfs":{"total":96636764160,"available":96389046272,"internally_reserved":0,"allocated":21282816,"data_stored":21110376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":226426880},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.1779999999999999,"15min":1.155},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.5980000000000008,"5min":9.5980000000000008,"15min":9.5980000000000008},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.1579999999999999,"15min":1.246},"min":{"1min":0.73399999999999999,"5min":0.56699999999999995,"15min":0.55900000000000005},"max":{"1min":3.9969999999999999,"5min":8.9870000000000001,"15min":11.206},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":4.0979999999999999,"15min":2.0499999999999998},"min":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.53000000000000003},"max":{"1min":2.1989999999999998,"5min":310.21100000000001,"15min":310.21100000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":4.2830000000000004,"15min":2.2989999999999999},"min":{"1min":0.93799999999999994,"5min":0.625,"15min":0.54700000000000004},"max":{"1min":5.7050000000000001,"5min":310.233,"15min":310.233},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.206,"15min":1.2390000000000001},"min":{"1min":0.69199999999999995,"5min":0.627,"15min":0.54400000000000004},"max":{"1min":2.968,"5min":5.7220000000000004,"15min":6.7220000000000004},"last":1.006},{"interface":"front","average":{"1min":1.208,"5min":1.4079999999999999,"15min":1.3360000000000001},"min":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.69099999999999995},"max":{"1min":1.744,"5min":6.3550000000000004,"15min":6.9199999999999999},"last":1.2230000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.7969999999999999,"15min":1.681},"min":{"1min":0.95399999999999996,"5min":0.71399999999999997,"15min":0.625},"max":{"1min":5.3540000000000001,"5min":8.7300000000000004,"15min":15.169},"last":1.298},{"interface":"front","average":{"1min":1.865,"5min":1.855,"15min":1.8440000000000001},"min":{"1min":1.1319999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":5.3170000000000002,"5min":8.6950000000000003,"15min":20.972000000000001},"last":1.28}]},{"osd":4,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":4.5640000000000001,"15min":2.4260000000000002},"min":{"1min":0.77200000000000002,"5min":0.68300000000000005,"15min":0.60199999999999998},"max":{"1min":2.093,"5min":310.73899999999998,"15min":310.73899999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.8200000000000001,"5min":4.6799999999999997,"15min":2.6040000000000001},"min":{"1min":0.96099999999999997,"5min":0.90300000000000002,"15min":0.79800000000000004},"max":{"1min":5.8319999999999999,"5min":309.93700000000001,"15min":309.93700000000001},"last":1.202}]},{"osd":5,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":0.999,"5min":0.86899999999999999,"15min":0.79700000000000004},"max":{"1min":3.8919999999999999,"5min":5.6100000000000003,"15min":7.3010000000000002},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.9179999999999999,"15min":1.7949999999999999},"min":{"1min":0.997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":4.0949999999999998,"5min":7.5919999999999996,"15min":7.7649999999999997},"last":1.429}]},{"osd":6,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":2.121,"15min":1.9590000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83899999999999997},"max":{"1min":3.5800000000000001,"5min":8.9239999999999995,"15min":11.238},"last":1.333},{"interface":"front","average":{"1min":2.1739999999999999,"5min":2.1970000000000001,"15min":2.0169999999999999},"min":{"1min":1.107,"5min":0.97699999999999998,"15min":0.91800000000000004},"max":{"1min":6.8890000000000002,"5min":9.952,"15min":11.032},"last":1.3959999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":4.7649999999999997,"15min":2.9380000000000002},"min":{"1min":1.3380000000000001,"5min":1.0880000000000001,"15min":0.753},"max":{"1min":4.2000000000000002,"5min":310.26100000000002,"15min":310.26100000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.619,"5min":5.0330000000000004,"15min":3.0470000000000002},"min":{"1min":1.2390000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3370000000000002,"5min":313.202,"15min":313.202},"last":1.526}]},{"osd":8,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.9750000000000001,"15min":1.9370000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":6.5129999999999999,"5min":8.7349999999999994,"15min":11.145},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.881,"5min":1.877,"15min":1.869},"min":{"1min":1.2649999999999999,"5min":1.1499999999999999,"15min":0.84599999999999997},"max":{"1min":5.2039999999999997,"5min":5.9260000000000002,"15min":8.4100000000000001},"last":1.6299999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":4.9089999999999998,"15min":2.8809999999999998},"min":{"1min":1.218,"5min":1.069,"15min":1.069},"max":{"1min":6.6379999999999999,"5min":311.82799999999997,"15min":311.82799999999997},"last":1.569},{"interface":"front","average":{"1min":1.802,"5min":4.7949999999999999,"15min":2.8410000000000002},"min":{"1min":1.403,"5min":1.2210000000000001,"15min":1.0880000000000001},"max":{"1min":3.1840000000000002,"5min":310.40800000000002,"15min":310.40800000000002},"last":1.4550000000000001}]}]},{"osd":10,"up_from":18,"seq":77309411644,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":522364,"kb_used_data":65844,"kb_used_omap":0,"kb_used_meta":456512,"kb_avail":93849476,"statfs":{"total":96636764160,"available":96101863424,"internally_reserved":0,"allocated":67424256,"data_stored":67247339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":467468288},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.3240000000000001},"min":{"1min":0.69099999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.577,"5min":17.451000000000001,"15min":17.451000000000001},"last":1.24},{"interface":"front","average":{"1min":1.276,"5min":1.5920000000000001,"15min":1.407},"min":{"1min":0.75900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":3.3679999999999999,"5min":17.646000000000001,"15min":17.646000000000001},"last":1.3320000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1140000000000001,"15min":1.1319999999999999},"min":{"1min":0.71599999999999997,"5min":0.60099999999999998,"15min":0.59699999999999998},"max":{"1min":1.2509999999999999,"5min":14.58,"15min":14.58},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.52,"15min":1.4350000000000001},"min":{"1min":0.63300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.948,"5min":16.050999999999998,"15min":16.050999999999998},"last":1.1399999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.2629999999999999,"15min":1.3500000000000001},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4700000000000002,"5min":5.1550000000000002,"15min":27},"last":1.651},{"interface":"front","average":{"1min":1.212,"5min":1.2669999999999999,"15min":1.3300000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64800000000000002},"max":{"1min":1.6240000000000001,"5min":4.391,"15min":9.8219999999999992},"last":1.4650000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.819,"15min":1.5589999999999999},"min":{"1min":0.83699999999999997,"5min":0.73899999999999999,"15min":0.68500000000000005},"max":{"1min":3.9489999999999998,"5min":15.452999999999999,"15min":15.452999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.7210000000000001,"15min":1.7050000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.69799999999999995},"max":{"1min":2.113,"5min":5.2789999999999999,"15min":16.129999999999999},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.617,"15min":1.5509999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.76500000000000001},"max":{"1min":2.8559999999999999,"5min":6.0940000000000003,"15min":7.3049999999999997},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.5549999999999999,"15min":1.5629999999999999},"min":{"1min":1.0229999999999999,"5min":0.93600000000000005,"15min":0.71999999999999997},"max":{"1min":2.048,"5min":7.2119999999999997,"15min":9.3699999999999992},"last":1.171}]},{"osd":5,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.952,"15min":1.893},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.745},"max":{"1min":3.097,"5min":15.561,"15min":40.746000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.889,"15min":1.8169999999999999},"min":{"1min":0.93899999999999995,"5min":0.92100000000000004,"15min":0.64900000000000002},"max":{"1min":2.702,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":1.5189999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":2.706,"15min":2.1629999999999998},"min":{"1min":1.1659999999999999,"5min":1.1060000000000001,"15min":0.91800000000000004},"max":{"1min":6.843,"5min":21.189,"15min":21.189},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.97,"5min":2.9319999999999999,"15min":2.286},"min":{"1min":1.244,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":7.0860000000000003,"5min":22.416,"15min":22.416},"last":1.492}]},{"osd":7,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":2.0579999999999998,"15min":1.958},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":0.97799999999999998},"max":{"1min":2.5950000000000002,"5min":9.4939999999999998,"15min":18.797999999999998},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.764,"15min":1.8260000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.008},"max":{"1min":2.4409999999999998,"5min":6.7699999999999996,"15min":9.6400000000000006},"last":1.623}]},{"osd":9,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.9490000000000001,"15min":1.9550000000000001},"min":{"1min":1.266,"5min":1.2390000000000001,"15min":1.143},"max":{"1min":2.52,"5min":9.9090000000000007,"15min":9.9090000000000007},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.7869999999999999,"5min":2.121,"15min":2.0699999999999998},"min":{"1min":1.153,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":3.3250000000000002,"5min":15.627000000000001,"15min":15.627000000000001},"last":1.5940000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.1619999999999999,"15min":2.1179999999999999},"min":{"1min":1.264,"5min":1.1539999999999999,"15min":1.044},"max":{"1min":2.8159999999999998,"5min":6.8970000000000002,"15min":10.279},"last":1.919},{"interface":"front","average":{"1min":1.7050000000000001,"5min":1.8200000000000001,"15min":1.9339999999999999},"min":{"1min":1.339,"5min":1.081,"15min":1.081},"max":{"1min":2.2829999999999999,"5min":5.0510000000000002,"15min":10.076000000000001},"last":1.895}]}]},{"osd":9,"up_from":18,"seq":77309411643,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153136,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":152832,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":156499968},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5860000000000001,"15min":1.522},"min":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":4.8869999999999996,"5min":8.0500000000000007,"15min":14.436},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.677,"15min":1.5049999999999999},"min":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.56299999999999994},"max":{"1min":2.181,"5min":7.2480000000000002,"15min":14.875999999999999},"last":0.93000000000000005}]},{"osd":1,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.573,"15min":1.357},"min":{"1min":0.70199999999999996,"5min":0.61299999999999999,"15min":0.58099999999999996},"max":{"1min":4.5499999999999998,"5min":6.8410000000000002,"15min":6.8410000000000002},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.6399999999999999,"15min":1.5549999999999999},"min":{"1min":0.71799999999999997,"5min":0.66500000000000004,"15min":0.66400000000000003},"max":{"1min":3.145,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.26}]},{"osd":2,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.9430000000000001,"15min":1.946},"min":{"1min":0.73599999999999999,"5min":0.67600000000000005,"15min":0.52800000000000002},"max":{"1min":4.3230000000000004,"5min":7.1449999999999996,"15min":67.947000000000003},"last":1.028},{"interface":"front","average":{"1min":1.74,"5min":2.0470000000000002,"15min":1.901},"min":{"1min":0.79700000000000004,"5min":0.71399999999999997,"15min":0.66300000000000003},"max":{"1min":4.6760000000000002,"5min":11.935,"15min":67.694999999999993},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.0150000000000001,"15min":1.9810000000000001},"min":{"1min":0.82399999999999995,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":4.4160000000000004,"5min":7.4960000000000004,"15min":27.167000000000002},"last":1.131},{"interface":"front","average":{"1min":1.5469999999999999,"5min":2.2549999999999999,"15min":2.3639999999999999},"min":{"1min":0.95899999999999996,"5min":0.65900000000000003,"15min":0.65800000000000003},"max":{"1min":2.5750000000000002,"5min":7.4420000000000002,"15min":50.762},"last":1.2010000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.99,"15min":1.895},"min":{"1min":1.0269999999999999,"5min":0.89400000000000002,"15min":0.72599999999999998},"max":{"1min":4.5759999999999996,"5min":6.7350000000000003,"15min":7.3529999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.6659999999999999,"5min":2.222,"15min":1.9770000000000001},"min":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.77500000000000002},"max":{"1min":2.4689999999999999,"5min":7.0170000000000003,"15min":7.0170000000000003},"last":1.556}]},{"osd":5,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.2069999999999999,"5min":2.1739999999999999,"15min":2.25},"min":{"1min":1.319,"5min":1.0680000000000001,"15min":0.97799999999999998},"max":{"1min":4.4909999999999997,"5min":6.8559999999999999,"15min":66.474000000000004},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.954,"5min":2.399,"15min":2.387},"min":{"1min":1.119,"5min":1.071,"15min":0.82799999999999996},"max":{"1min":4.5259999999999998,"5min":7.1849999999999996,"15min":66.432000000000002},"last":1.647}]},{"osd":6,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":4.8209999999999997,"5min":3.8109999999999999,"15min":3.4849999999999999},"min":{"1min":1.1439999999999999,"5min":0.89800000000000002,"15min":0.79000000000000004},"max":{"1min":31.984999999999999,"5min":31.984999999999999,"15min":177.542},"last":1.385},{"interface":"front","average":{"1min":4.282,"5min":3.8170000000000002,"15min":3.641},"min":{"1min":1.4890000000000001,"5min":1.3080000000000001,"15min":1.1180000000000001},"max":{"1min":23.193000000000001,"5min":23.193000000000001,"15min":178.292},"last":1.6830000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.157,"5min":2.4209999999999998,"15min":2.4249999999999998},"min":{"1min":1.135,"5min":1.0309999999999999,"15min":0.88100000000000001},"max":{"1min":5.0039999999999996,"5min":12.064,"15min":66.763999999999996},"last":1.5069999999999999},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4510000000000001,"15min":2.5659999999999998},"min":{"1min":1.365,"5min":1.2170000000000001,"15min":1.04},"max":{"1min":4.2919999999999998,"5min":7.9100000000000001,"15min":65.933999999999997},"last":1.534}]},{"osd":10,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":2.4990000000000001,"15min":2.25},"min":{"1min":1.2669999999999999,"5min":0.96799999999999997,"15min":0.94499999999999995},"max":{"1min":5.0759999999999996,"5min":11.321999999999999,"15min":11.321999999999999},"last":1.744},{"interface":"front","average":{"1min":2.2589999999999999,"5min":2.5449999999999999,"15min":2.403},"min":{"1min":1.4339999999999999,"5min":1.153,"15min":0.91100000000000003},"max":{"1min":4.1349999999999998,"5min":7.2210000000000001,"15min":7.2210000000000001},"last":1.6140000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":2.6989999999999998,"15min":2.5859999999999999},"min":{"1min":1.1850000000000001,"5min":1.1659999999999999,"15min":0.95899999999999996},"max":{"1min":6.5510000000000002,"5min":7.782,"15min":66.094999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":2.5640000000000001,"5min":2.4769999999999999,"15min":2.5619999999999998},"min":{"1min":1.325,"5min":1.133,"15min":1.014},"max":{"1min":6.367,"5min":11.57,"15min":66.566000000000003},"last":1.6279999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411643,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350116,"kb_used_data":64604,"kb_used_omap":0,"kb_used_meta":285504,"kb_avail":94021724,"statfs":{"total":96636764160,"available":96278245376,"internally_reserved":0,"allocated":66154496,"data_stored":65978896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":292356096},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.145,"15min":1.175},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.637,"5min":5.056,"15min":13.025},"last":0.873},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2649999999999999,"15min":1.2090000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9199999999999999,"5min":8.9220000000000006,"15min":12.997},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.53,"15min":1.357},"min":{"1min":0.61199999999999999,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":6.7960000000000003,"5min":6.7960000000000003,"15min":13.821999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.4470000000000001,"15min":1.4710000000000001},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":6.2030000000000003,"5min":6.2030000000000003,"15min":13.683999999999999},"last":1.3620000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6559999999999999,"15min":1.4710000000000001},"min":{"1min":0.72399999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"max":{"1min":6.4850000000000003,"5min":8.2059999999999995,"15min":14.170999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.579,"15min":1.6479999999999999},"min":{"1min":0.94399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.8149999999999999,"5min":8.2379999999999995,"15min":14.146000000000001},"last":1.1910000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.675,"15min":1.5780000000000001},"min":{"1min":0.77100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.4829999999999997,"5min":8.7929999999999993,"15min":13.715999999999999},"last":1.157},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.83399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":6.6699999999999999,"5min":6.6699999999999999,"15min":14.430999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.7530000000000001,"5min":3.0369999999999999,"15min":2.2370000000000001},"min":{"1min":1.05,"5min":0.85799999999999998,"15min":0.65400000000000003},"max":{"1min":12.843,"5min":28.844000000000001,"15min":28.844000000000001},"last":1.325},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.8410000000000002,"15min":2.0939999999999999},"min":{"1min":1.0229999999999999,"5min":0.80800000000000005,"15min":0.70699999999999996},"max":{"1min":12.247999999999999,"5min":29.361000000000001,"15min":29.361000000000001},"last":1.2869999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.7210000000000001,"15min":1.8300000000000001},"min":{"1min":1.03,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":4.1319999999999997,"5min":5.7720000000000002,"15min":14.004},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.734,"5min":1.923,"15min":1.8220000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":4.2699999999999996,"5min":10.292999999999999,"15min":13.478},"last":1.4750000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.9410000000000001,"15min":1.909},"min":{"1min":1.089,"5min":1.089,"15min":0.94799999999999995},"max":{"1min":3.7189999999999999,"5min":5.9109999999999996,"15min":13.861000000000001},"last":1.536},{"interface":"front","average":{"1min":2.0219999999999998,"5min":2.0790000000000002,"15min":2.0150000000000001},"min":{"1min":1.0129999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":4.1630000000000003,"5min":9.5169999999999995,"15min":13.359},"last":1.623}]},{"osd":9,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.4239999999999999,"5min":2.4990000000000001,"15min":2.1549999999999998},"min":{"1min":1.1220000000000001,"5min":1.046,"15min":1.0429999999999999},"max":{"1min":6.5990000000000002,"5min":28.672999999999998,"15min":28.672999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.841,"5min":1.96,"15min":2.0630000000000002},"min":{"1min":1.2090000000000001,"5min":1.091,"15min":1.091},"max":{"1min":4.0629999999999997,"5min":5.726,"15min":14.271000000000001},"last":1.653}]},{"osd":10,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.1240000000000001,"15min":1.9359999999999999},"min":{"1min":1.2629999999999999,"5min":1.1140000000000001,"15min":1.0289999999999999},"max":{"1min":4.3739999999999997,"5min":10.159000000000001,"15min":13.597},"last":1.7729999999999999},{"interface":"front","average":{"1min":2.1520000000000001,"5min":2.1030000000000002,"15min":1.996},"min":{"1min":1.226,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":6.7350000000000003,"5min":6.7569999999999997,"15min":14.555},"last":1.6060000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":2.194,"15min":2.1709999999999998},"min":{"1min":1.161,"5min":1.161,"15min":1.1579999999999999},"max":{"1min":4.5179999999999998,"5min":5.7370000000000001,"15min":14.396000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":2.2000000000000002,"5min":2.2770000000000001,"15min":2.04},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.9980000000000002,"5min":9.4000000000000004,"15min":13.894},"last":1.899}]}]},{"osd":0,"up_from":18,"seq":77309411643,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321840,"kb_used_data":37160,"kb_used_omap":0,"kb_used_meta":284672,"kb_avail":94050000,"statfs":{"total":96636764160,"available":96307200000,"internally_reserved":0,"allocated":38051840,"data_stored":37887017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":291504128},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":1.677,"15min":1.401},"min":{"1min":0.65900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":5.7969999999999997,"5min":12.207000000000001,"15min":12.207000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.554,"15min":1.4019999999999999},"min":{"1min":0.67800000000000005,"5min":0.625,"15min":0.57099999999999995},"max":{"1min":6.2960000000000003,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.4930000000000001,"15min":1.4590000000000001},"min":{"1min":0.625,"5min":0.61699999999999999,"15min":0.59999999999999998},"max":{"1min":4.0940000000000003,"5min":5.7990000000000004,"15min":19.777999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.7869999999999999,"15min":1.6220000000000001},"min":{"1min":0.81100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":6.4240000000000004,"5min":8.1519999999999992,"15min":8.1519999999999992},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":2.48,"15min":2.1720000000000002},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":6.2309999999999999,"5min":12.323,"15min":28.312000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.837,"5min":1.5640000000000001,"15min":1.726},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.57499999999999996},"max":{"1min":4.5339999999999998,"5min":5.1150000000000002,"15min":19.666},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.784,"5min":2.1019999999999999,"15min":1.8600000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":7.1040000000000001,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":1.0569999999999999},{"interface":"front","average":{"1min":2.0369999999999999,"5min":2.29,"15min":2.0419999999999998},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":6.3710000000000004,"5min":15.186999999999999,"15min":19.378},"last":1.1890000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":2.4289999999999998,"15min":2.258},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.73499999999999999},"max":{"1min":6.5949999999999998,"5min":14.744999999999999,"15min":19.501000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.1269999999999998,"5min":2.0409999999999999,"15min":2.0110000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84399999999999997},"max":{"1min":9.2159999999999993,"5min":9.2159999999999993,"15min":19.905000000000001},"last":1.0880000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":2.629,"15min":2.411},"min":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.75900000000000001},"max":{"1min":4.5209999999999999,"5min":10.334,"15min":21.288},"last":1.2110000000000001},{"interface":"front","average":{"1min":2.3069999999999999,"5min":3.4569999999999999,"15min":2.8050000000000002},"min":{"1min":1.1100000000000001,"5min":1.0960000000000001,"15min":0.82199999999999995},"max":{"1min":7.1879999999999997,"5min":41.530999999999999,"15min":41.530999999999999},"last":1.371}]},{"osd":7,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":2.5289999999999999,"15min":2.3559999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":6.4850000000000003,"5min":12.43,"15min":21.946000000000002},"last":1.1140000000000001},{"interface":"front","average":{"1min":2.282,"5min":2.2229999999999999,"15min":2.1829999999999998},"min":{"1min":1.222,"5min":1.1180000000000001,"15min":0.879},"max":{"1min":4.4749999999999996,"5min":6.0739999999999998,"15min":21.530000000000001},"last":1.296}]},{"osd":8,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":2.3620000000000001,"15min":2.3599999999999999},"min":{"1min":1.2410000000000001,"5min":1.018,"15min":1.018},"max":{"1min":7.2649999999999997,"5min":11.76,"15min":19.030999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":2.3220000000000001,"5min":2.6190000000000002,"15min":2.5459999999999998},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":6.8310000000000004,"5min":12.532,"15min":19.600999999999999},"last":1.276}]},{"osd":10,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.371,"5min":2.839,"15min":2.6339999999999999},"min":{"1min":1.204,"5min":1.204,"15min":1.204},"max":{"1min":6.7160000000000002,"5min":15.432,"15min":19.678999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":2.5,"5min":2.4159999999999999,"15min":2.3439999999999999},"min":{"1min":1.3620000000000001,"5min":1.1879999999999999,"15min":0.995},"max":{"1min":6.3550000000000004,"5min":6.3550000000000004,"15min":21.41},"last":1.3999999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.1549999999999998,"5min":2.5670000000000002,"15min":2.3959999999999999},"min":{"1min":1.3089999999999999,"5min":1.1519999999999999,"15min":1.131},"max":{"1min":7.3559999999999999,"5min":8.3979999999999997,"15min":19.155999999999999},"last":1.5},{"interface":"front","average":{"1min":2.605,"5min":2.9209999999999998,"15min":2.6789999999999998},"min":{"1min":1.264,"5min":1.264,"15min":1.26},"max":{"1min":7.0090000000000003,"5min":12.634,"15min":19.818000000000001},"last":1.4219999999999999}]}]},{"osd":3,"up_from":18,"seq":77309411643,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":626964,"kb_used_data":107788,"kb_used_omap":0,"kb_used_meta":519168,"kb_avail":93744876,"statfs":{"total":96636764160,"available":95994753024,"internally_reserved":0,"allocated":110374912,"data_stored":110193384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":531628032},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.6970000000000001,"15min":1.5049999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":8.9789999999999992,"15min":9.4689999999999994},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6879999999999999,"15min":1.4730000000000001},"min":{"1min":0.69599999999999995,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":3.3479999999999999,"5min":4.6260000000000003,"15min":8.6880000000000006},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.6479999999999999,"15min":1.486},"min":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2989999999999999,"5min":8.4220000000000006,"15min":8.4220000000000006},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.7390000000000001,"15min":1.593},"min":{"1min":0.89800000000000002,"5min":0.745,"15min":0.58699999999999997},"max":{"1min":2.6040000000000001,"5min":4.7430000000000003,"15min":6.7709999999999999},"last":1.357}]},{"osd":4,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.6519999999999999,"15min":1.4830000000000001},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3180000000000001,"5min":6.1879999999999997,"15min":6.1879999999999997},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.9079999999999999,"15min":1.6639999999999999},"min":{"1min":0.94099999999999995,"5min":0.69799999999999995,"15min":0.67200000000000004},"max":{"1min":4.702,"5min":6.9850000000000003,"15min":6.9850000000000003},"last":1.1619999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":2.0139999999999998,"15min":1.841},"min":{"1min":1.0009999999999999,"5min":0.81899999999999995,"15min":0.69999999999999996},"max":{"1min":3.238,"5min":7.1509999999999998,"15min":23.041},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.9570000000000001,"15min":1.8380000000000001},"min":{"1min":0.80800000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.407,"5min":6.9619999999999997,"15min":22.581},"last":1.056}]},{"osd":6,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.5779999999999998,"5min":2.96,"15min":2.5510000000000002},"min":{"1min":1.04,"5min":0.84699999999999998,"15min":0.69699999999999995},"max":{"1min":18.344999999999999,"5min":23.417000000000002,"15min":67.936999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.7639999999999998,"15min":2.218},"min":{"1min":1.0669999999999999,"5min":0.86099999999999999,"15min":0.82999999999999996},"max":{"1min":17.199000000000002,"5min":19.280999999999999,"15min":19.280999999999999},"last":1.254}]},{"osd":7,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.879,"5min":2.246,"15min":1.8939999999999999},"min":{"1min":1.3109999999999999,"5min":1.089,"15min":0.84899999999999998},"max":{"1min":3.056,"5min":7.8310000000000004,"15min":7.8310000000000004},"last":1.478},{"interface":"front","average":{"1min":1.8220000000000001,"5min":2.3290000000000002,"15min":2.0499999999999998},"min":{"1min":1.0860000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.7130000000000001,"5min":10.206,"15min":10.206},"last":1.2969999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":2.2109999999999999,"15min":2.0249999999999999},"min":{"1min":1.141,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.0379999999999998,"5min":8.7629999999999999,"15min":10.893000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":2.1160000000000001,"5min":2.2029999999999998,"15min":2.0550000000000002},"min":{"1min":1.4239999999999999,"5min":1.216,"15min":1.02},"max":{"1min":3.4209999999999998,"5min":4.5060000000000002,"15min":10.787000000000001},"last":1.7629999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.5499999999999998,"15min":2.3100000000000001},"min":{"1min":1.3540000000000001,"5min":1.157,"15min":1.081},"max":{"1min":3.556,"5min":6.8920000000000003,"15min":9.0779999999999994},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.927,"5min":2.444,"15min":2.2320000000000002},"min":{"1min":1.3109999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.2639999999999998,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.417}]},{"osd":10,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":2.4860000000000002,"15min":2.23},"min":{"1min":1.2470000000000001,"5min":1.1499999999999999,"15min":1.1000000000000001},"max":{"1min":3.149,"5min":8.875,"15min":8.875},"last":1.5209999999999999},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.3650000000000002,"15min":2.085},"min":{"1min":1.2609999999999999,"5min":1.1899999999999999,"15min":1.0569999999999999},"max":{"1min":4.4770000000000003,"5min":7.7089999999999996,"15min":7.7089999999999996},"last":1.569}]},{"osd":11,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.488,"15min":2.2410000000000001},"min":{"1min":1.4379999999999999,"5min":1.2969999999999999,"15min":1.0860000000000001},"max":{"1min":3.4849999999999999,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":1.6830000000000001},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.4260000000000002,"15min":2.2749999999999999},"min":{"1min":1.4690000000000001,"5min":1.1479999999999999,"15min":1.1459999999999999},"max":{"1min":2.7290000000000001,"5min":6.7889999999999997,"15min":10.993},"last":1.5980000000000001}]}]},{"osd":4,"up_from":18,"seq":77309411644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353780,"kb_used_data":74028,"kb_used_omap":0,"kb_used_meta":279744,"kb_avail":94018060,"statfs":{"total":96636764160,"available":96274493440,"internally_reserved":0,"allocated":75804672,"data_stored":75635787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":286457856},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.101,"15min":1.081},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54400000000000004},"max":{"1min":3.3500000000000001,"5min":4.0090000000000003,"15min":4.7480000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7569999999999997,"5min":5.734,"15min":10.750999999999999},"last":1.3089999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.139,"15min":1.171},"min":{"1min":0.63700000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.5800000000000001,"5min":4.1749999999999998,"15min":5.4240000000000004},"last":1.331},{"interface":"front","average":{"1min":1.085,"5min":1.3009999999999999,"15min":1.3600000000000001},"min":{"1min":0.75,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.518,"5min":5.4379999999999997,"15min":6.8659999999999997},"last":1.5229999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.5620000000000001,"15min":1.3280000000000001},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.0039999999999996,"5min":28.899999999999999,"15min":28.899999999999999},"last":1.383},{"interface":"front","average":{"1min":1.746,"5min":1.9279999999999999,"15min":1.6279999999999999},"min":{"1min":0.80100000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.173,"5min":28.882000000000001,"15min":28.882000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.4470000000000001,"15min":1.343},"min":{"1min":0.65500000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.8439999999999999,"5min":6.1589999999999998,"15min":6.1760000000000002},"last":1.196},{"interface":"front","average":{"1min":1.631,"5min":1.3240000000000001,"15min":1.2949999999999999},"min":{"1min":0.78600000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":6.5129999999999999,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":1.002}]},{"osd":6,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":2.0030000000000001,"15min":1.6200000000000001},"min":{"1min":0.86899999999999999,"5min":0.73099999999999998,"15min":0.67800000000000005},"max":{"1min":2.621,"5min":18.018000000000001,"15min":18.018000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":2.2570000000000001,"15min":1.835},"min":{"1min":0.874,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":4.3140000000000001,"5min":18.004000000000001,"15min":18.004000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5,"15min":1.5309999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.6309999999999998,"5min":6.2300000000000004,"15min":6.7400000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.782,"5min":1.528,"15min":1.4890000000000001},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":6.2809999999999997,"5min":6.2809999999999997,"15min":7.6699999999999999},"last":0.73699999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.5640000000000001,"15min":1.603},"min":{"1min":0.89100000000000001,"5min":0.79800000000000004,"15min":0.76100000000000001},"max":{"1min":4.319,"5min":4.319,"15min":6.2560000000000002},"last":1.155},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.7210000000000001,"15min":1.7589999999999999},"min":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.532,"5min":6.3710000000000004,"15min":10.625999999999999},"last":1.4019999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":1.7749999999999999,"15min":1.7589999999999999},"min":{"1min":1.0269999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":6.4480000000000004},"last":1.236},{"interface":"front","average":{"1min":1.593,"5min":1.8620000000000001,"15min":1.8779999999999999},"min":{"1min":1.0620000000000001,"5min":0.99399999999999999,"15min":0.90800000000000003},"max":{"1min":2.806,"5min":6.5449999999999999,"15min":6.6310000000000002},"last":1.6040000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.6499999999999999,"15min":1.651},"min":{"1min":1.1240000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.9099999999999999,"5min":1.8180000000000001,"15min":1.796},"min":{"1min":1.1539999999999999,"5min":1.0860000000000001,"15min":1.0349999999999999},"max":{"1min":4.8170000000000002,"5min":7.9329999999999998,"15min":7.9329999999999998},"last":1.4199999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.8300000000000001,"15min":1.845},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.9279999999999999,"5min":6.4829999999999997,"15min":6.6210000000000004},"last":1.76},{"interface":"front","average":{"1min":1.794,"5min":1.694,"15min":1.675},"min":{"1min":1.1399999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":6.4009999999999998,"5min":6.4009999999999998,"15min":6.4009999999999998},"last":1.48}]}]},{"osd":5,"up_from":18,"seq":77309411644,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458500,"kb_used_data":38140,"kb_used_omap":0,"kb_used_meta":420352,"kb_avail":93913340,"statfs":{"total":96636764160,"available":96167260160,"internally_reserved":0,"allocated":39055360,"data_stored":38889481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":430440448},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.268,"15min":1.861},"min":{"1min":0.61899999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.2300000000000004,"5min":12.923,"15min":173.643},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3520000000000001,"15min":2.0670000000000002},"min":{"1min":0.64800000000000002,"5min":0.63,"15min":0.56299999999999994},"max":{"1min":5.6470000000000002,"5min":10.327999999999999,"15min":173.71899999999999},"last":1.0589999999999999}]},{"osd":1,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4159999999999999,"15min":1.3},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.51800000000000002},"max":{"1min":3.113,"5min":13.898999999999999,"15min":13.898999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.4990000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59099999999999997},"max":{"1min":4.3680000000000003,"5min":10.234,"15min":10.234},"last":1.5249999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.66200000000000003,"5min":0.57899999999999996,"15min":0.54500000000000004},"max":{"1min":5.7720000000000002,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.5149999999999999,"15min":1.3580000000000001},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.55800000000000005},"max":{"1min":4.1920000000000002,"5min":10.614000000000001,"15min":10.614000000000001},"last":0.90500000000000003}]},{"osd":4,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4690000000000001,"15min":1.454},"min":{"1min":0.95599999999999996,"5min":0.623,"15min":0.623},"max":{"1min":3.3610000000000002,"5min":10.728,"15min":10.728},"last":1.708},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.532,"15min":1.544},"min":{"1min":0.83499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.8899999999999997,"5min":10.449999999999999,"15min":10.449999999999999},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.1379999999999999,"15min":1.821},"min":{"1min":1.1000000000000001,"5min":0.93300000000000005,"15min":0.70999999999999996},"max":{"1min":7.7080000000000002,"5min":13.782,"15min":13.782},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.8680000000000001,"5min":2.3730000000000002,"15min":1.9850000000000001},"min":{"1min":0.98699999999999999,"5min":0.89200000000000002,"15min":0.64900000000000002},"max":{"1min":7.633,"5min":20.225999999999999,"15min":20.225999999999999},"last":1.2030000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.8169999999999999,"15min":1.786},"min":{"1min":1.04,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":6.3090000000000002,"5min":10.957000000000001,"15min":11.082000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.97,"5min":1.8899999999999999,"15min":1.8520000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.0329999999999999},"max":{"1min":6.0199999999999996,"5min":11.054,"15min":11.054},"last":1.4630000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":2.0960000000000001,"15min":1.972},"min":{"1min":1.224,"5min":1.089,"15min":1.0449999999999999},"max":{"1min":5.1589999999999998,"5min":18.199000000000002,"15min":18.199000000000002},"last":1.333},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.895,"15min":1.7350000000000001},"min":{"1min":0.99199999999999999,"5min":0.95699999999999996,"15min":0.76000000000000001},"max":{"1min":5.2149999999999999,"5min":13.041,"15min":13.041},"last":1.6739999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.3359999999999999,"15min":1.994},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.86099999999999999},"max":{"1min":11.369,"5min":13.15,"15min":13.15},"last":1.3799999999999999},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1259999999999999,"15min":2.0030000000000001},"min":{"1min":1.256,"5min":1.1890000000000001,"15min":0.92000000000000004},"max":{"1min":6.6820000000000004,"5min":10.837,"15min":10.837},"last":1.55}]},{"osd":10,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.99,"15min":1.988},"min":{"1min":1.1699999999999999,"5min":1.139,"15min":1.071},"max":{"1min":6.1820000000000004,"5min":16.297999999999998,"15min":16.297999999999998},"last":1.649},{"interface":"front","average":{"1min":2.1200000000000001,"5min":2.016,"15min":2.0129999999999999},"min":{"1min":1.323,"5min":1.2410000000000001,"15min":1.24},"max":{"1min":5.0780000000000003,"5min":10.949999999999999,"15min":10.949999999999999},"last":1.7909999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":2.3780000000000001,"15min":2.073},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":0.96599999999999997},"max":{"1min":11.234999999999999,"5min":13.420999999999999,"15min":13.420999999999999},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.974,"5min":2.516,"15min":2.282},"min":{"1min":1.417,"5min":1.2949999999999999,"15min":1.101},"max":{"1min":4.2599999999999998,"5min":19.321999999999999,"15min":19.321999999999999},"last":1.8720000000000001}]}]},{"osd":6,"up_from":18,"seq":77309411643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":499108,"kb_used_data":85084,"kb_used_omap":0,"kb_used_meta":414016,"kb_avail":93872732,"statfs":{"total":96636764160,"available":96125677568,"internally_reserved":0,"allocated":87126016,"data_stored":86950416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":423952384},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.885,"15min":1.591},"min":{"1min":0.68700000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":9.7620000000000005,"5min":12.869999999999999,"15min":12.869999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.982,"5min":2.0550000000000002,"15min":1.6339999999999999},"min":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":8.7110000000000003,"5min":19.547999999999998,"15min":19.547999999999998},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.1070000000000002,"15min":1.675},"min":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.55400000000000005},"max":{"1min":5.3259999999999996,"5min":27.954999999999998,"15min":27.954999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.496,"5min":2.2010000000000001,"15min":1.806},"min":{"1min":0.89100000000000001,"5min":0.73499999999999999,"15min":0.57099999999999995},"max":{"1min":3.597,"5min":16.134,"15min":16.134},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.9419999999999999,"15min":1.6699999999999999},"min":{"1min":0.84499999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":5.8499999999999996,"5min":15.946,"15min":15.946},"last":1.161},{"interface":"front","average":{"1min":1.6020000000000001,"5min":2.2709999999999999,"15min":1.8740000000000001},"min":{"1min":0.77800000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":5.5259999999999998,"5min":28.532,"15min":28.532},"last":0.95899999999999996}]},{"osd":3,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":2.77,"15min":2.5129999999999999},"min":{"1min":0.99199999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":6.1920000000000002,"5min":19.510999999999999,"15min":96.781999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.907,"5min":2.6429999999999998,"15min":2.4980000000000002},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.69299999999999995},"max":{"1min":6.5960000000000001,"5min":16.683,"15min":96.558999999999997},"last":1.254}]},{"osd":4,"last update":"Fri Nov 20 11:42:58 2020","interfaces":[{"interface":"back","average":{"1min":3.823,"5min":2.8650000000000002,"15min":2.2400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":28.073,"5min":28.484999999999999,"15min":28.484999999999999},"last":1.085},{"interface":"front","average":{"1min":2.379,"5min":2.4870000000000001,"15min":2.0910000000000002},"min":{"1min":1.0169999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":9.6899999999999995,"5min":16.672000000000001,"15min":16.672000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":2.9830000000000001,"15min":2.4220000000000002},"min":{"1min":0.95799999999999996,"5min":0.879,"15min":0.85399999999999998},"max":{"1min":5.7919999999999998,"5min":28.622,"15min":28.622},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.9490000000000001,"5min":2.7549999999999999,"15min":2.2690000000000001},"min":{"1min":1.179,"5min":0.88700000000000001,"15min":0.83799999999999997},"max":{"1min":6.3360000000000003,"5min":19.669,"15min":19.669},"last":1.391}]},{"osd":7,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2599999999999998,"5min":3.218,"15min":2.5139999999999998},"min":{"1min":1.091,"5min":1.089,"15min":1.03},"max":{"1min":6.032,"5min":30.012,"15min":30.012},"last":1.51},{"interface":"front","average":{"1min":2.0190000000000001,"5min":2.7749999999999999,"15min":2.3109999999999999},"min":{"1min":1.1639999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":6.4640000000000004,"5min":16.712,"15min":16.712},"last":1.294}]},{"osd":8,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.3340000000000001,"5min":3.4199999999999999,"15min":2.6389999999999998},"min":{"1min":1.3320000000000001,"5min":1.2210000000000001,"15min":0.97299999999999998},"max":{"1min":5.9109999999999996,"5min":28.960000000000001,"15min":28.960000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":2.0680000000000001,"5min":3.097,"15min":2.4590000000000001},"min":{"1min":1.321,"5min":1.04,"15min":1.04},"max":{"1min":6.5830000000000002,"5min":19.800000000000001,"15min":19.800000000000001},"last":1.4870000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.9390000000000001,"5min":2.7480000000000002,"15min":2.3140000000000001},"min":{"1min":1.198,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":6.1909999999999998,"5min":16.420000000000002,"15min":16.420000000000002},"last":1.458},{"interface":"front","average":{"1min":2.5310000000000001,"5min":3.496,"15min":2.7789999999999999},"min":{"1min":1.3280000000000001,"5min":1.2070000000000001,"15min":1.1020000000000001},"max":{"1min":6.1550000000000002,"5min":28.882999999999999,"15min":28.882999999999999},"last":1.605}]},{"osd":11,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":3.444,"15min":2.6709999999999998},"min":{"1min":1.4159999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":6.6779999999999999,"5min":19.920999999999999,"15min":19.920999999999999},"last":1.583},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.8919999999999999,"15min":2.4409999999999998},"min":{"1min":1.2889999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":6.0720000000000001,"5min":16.553000000000001,"15min":16.553000000000001},"last":1.361}]}]}]}} 2020-11-20T11:44:02.141 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:18:01.713630+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=18, tm_sec=1, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T11:44:02.142 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T11:44:22.143 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:44:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.251+0000 7fec3d151700 1 Processor -- start 2020-11-20T11:44:22.273 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.251+0000 7fec3d151700 1 -- start start 2020-11-20T11:44:22.274 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3d151700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fec380c35e0 0x7fec380c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3d151700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fec380bea40 0x7fec380bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3d151700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec38151050 con 0x7fec380bc530 2020-11-20T11:44:22.280 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3d151700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380bacc0 con 0x7fec380c35e0 2020-11-20T11:44:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3d151700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec381512f0 con 0x7fec380bea40 2020-11-20T11:44:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3c950700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fec380bc530 0x7fec38065880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35982/0 (socket says 172.21.15.112:35982) 2020-11-20T11:44:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.252+0000 7fec3c950700 1 -- 172.21.15.112:0/389075457 learned_addr learned my addr 172.21.15.112:0/389075457 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:44:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 --2- 172.21.15.112:0/389075457 >> v2:172.21.15.204:3300/0 conn(0x7fec380bea40 0x7fec380bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec37fff700 1 --2- 172.21.15.112:0/389075457 >> v2:172.21.15.166:3300/0 conn(0x7fec380c35e0 0x7fec380c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857606759 0 0) 0x7fec38151050 con 0x7fec380bc530 2020-11-20T11:44:22.290 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec18003280 con 0x7fec380bc530 2020-11-20T11:44:22.295 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 106524232 0 0) 0x7fec18003280 con 0x7fec380bc530 2020-11-20T11:44:22.298 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 -- 172.21.15.112:0/389075457 >> v2:172.21.15.166:3300/0 conn(0x7fec380c35e0 msgr2=0x7fec380c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:44:22.301 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 --2- 172.21.15.112:0/389075457 >> v2:172.21.15.166:3300/0 conn(0x7fec380c35e0 0x7fec380c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.303 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 -- 172.21.15.112:0/389075457 >> v1:172.21.15.112:6789/0 conn(0x7fec380bc530 legacy=0x7fec38065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 -- 172.21.15.112:0/389075457 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38151590 con 0x7fec380bea40 2020-11-20T11:44:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec377fe700 1 --2- 172.21.15.112:0/389075457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec380bc040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fec380c3eb0 tx=0x7fec20006e30).ready entity=mon.2 client_cookie=8df05d4887396d98 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 <== mon.2 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300018f0 con 0x7fec380bea40 2020-11-20T11:44:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 <== mon.2 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20000e90 con 0x7fec380bea40 2020-11-20T11:44:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.253+0000 7fec36ffd700 1 -- 172.21.15.112:0/389075457 <== mon.2 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20011610 con 0x7fec380bea40 2020-11-20T11:44:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 -- 172.21.15.112:0/389075457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 msgr2=0x7fec380bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 --2- 172.21.15.112:0/389075457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec380bc040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fec380c3eb0 tx=0x7fec20006e30).stop 2020-11-20T11:44:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 -- 172.21.15.112:0/389075457 shutdown_connections 2020-11-20T11:44:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 --2- 172.21.15.112:0/389075457 >> v2:172.21.15.166:3300/0 conn(0x7fec380c35e0 0x7fec380c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 --2- 172.21.15.112:0/389075457 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec380bc040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 -- 172.21.15.112:0/389075457 >> 172.21.15.112:0/389075457 conn(0x7fec3805bac0 msgr2=0x7fec38064930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 -- 172.21.15.112:0/389075457 shutdown_connections 2020-11-20T11:44:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.254+0000 7fec3d151700 1 -- 172.21.15.112:0/389075457 wait complete. 2020-11-20T11:44:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.255+0000 7fec3d151700 1 Processor -- start 2020-11-20T11:44:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.255+0000 7fec3d151700 1 -- start start 2020-11-20T11:44:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec3815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fec380c35e0 0x7fec3815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c3260 con 0x7fec380bc530 2020-11-20T11:44:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3815c530 con 0x7fec380c35e0 2020-11-20T11:44:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec381607b0 con 0x7fec380bea40 2020-11-20T11:44:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51790/0 (socket says 172.21.15.112:51790) 2020-11-20T11:44:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 -- 172.21.15.112:0/1097434730 learned_addr learned my addr 172.21.15.112:0/1097434730 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:44:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3c950700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fec380c35e0 0x7fec3815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 -- 172.21.15.112:0/1097434730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 msgr2=0x7fec3815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec377fe700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec3815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec3815a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 -- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fec380c35e0 msgr2=0x7fec3815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fec380c35e0 0x7fec3815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 -- 172.21.15.112:0/1097434730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3814be30 con 0x7fec380bc530 2020-11-20T11:44:22.312 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec37fff700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fec2800ebd0 tx=0x7fec28006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.312 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2800c9b0 con 0x7fec380bc530 2020-11-20T11:44:22.312 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2800cb10 con 0x7fec380bc530 2020-11-20T11:44:22.312 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2800ce90 con 0x7fec380bc530 2020-11-20T11:44:22.312 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec38160270 con 0x7fec380bc530 2020-11-20T11:44:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.256+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3815c790 con 0x7fec380bc530 2020-11-20T11:44:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.257+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380008d0 con 0x7fec380bc530 2020-11-20T11:44:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.258+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fec28012600 con 0x7fec380bc530 2020-11-20T11:44:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.258+0000 7fec2ffff700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 0x7fec14082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.259+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fec280a2e80 con 0x7fec380bc530 2020-11-20T11:44:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.259+0000 7fec377fe700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 0x7fec14082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.259+0000 7fec377fe700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 0x7fec14082b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fec2000c010 tx=0x7fec20015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.262+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fec28077890 con 0x7fec380bc530 2020-11-20T11:44:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.404+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 --> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec380ba3a0 con 0x7fec14080670 2020-11-20T11:44:22.413 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.410+0000 7fec2ffff700 1 -- 172.21.15.112:0/1097434730 <== mgr.4111 v2:172.21.15.166:6800/22614 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149340 (secure 0 0 0) 0x7fec380ba3a0 con 0x7fec14080670 2020-11-20T11:44:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2020-11-20T11:44:22.418 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 msgr2=0x7fec14082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 0x7fec14082b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fec2000c010 tx=0x7fec20015000).stop 2020-11-20T11:44:22.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 msgr2=0x7fec3815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.419 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fec2800ebd0 tx=0x7fec28006e30).stop 2020-11-20T11:44:22.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 shutdown_connections 2020-11-20T11:44:22.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7fec14080670 0x7fec14082b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.420 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fec380c35e0 0x7fec3815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.421 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec380bc530 0x7fec3815ced0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.421 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 --2- 172.21.15.112:0/1097434730 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec380bea40 0x7fec3815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.421 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 >> 172.21.15.112:0/1097434730 conn(0x7fec3805bac0 msgr2=0x7fec380befd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 shutdown_connections 2020-11-20T11:44:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.412+0000 7fec3d151700 1 -- 172.21.15.112:0/1097434730 wait complete. 2020-11-20T11:44:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2020-11-20T11:44:22.428 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":814,"stamp":"2020-11-20T11:44:20.406357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":251393224,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":19623,"num_read_kb":1133421,"num_write":314277,"num_write_kb":6512178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600901,"num_omap_keys":953,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160903,"ondisk_log_size":160903,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3911480,"kb_used_data":494616,"kb_used_omap":0,"kb_used_meta":3416768,"kb_avail":1128550600,"statfs":{"total":1159641169920,"available":1155635814400,"internally_reserved":0,"allocated":506486784,"data_stored":504445820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3498770432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002891"},"pg_stats":[{"pgid":"4.2","version":"29'27790","reported_seq":"28995","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:47.183857+0000","last_change":"2020-11-20T11:43:47.183974+0000","last_active":"2020-11-20T11:43:47.183857+0000","last_peered":"2020-11-20T11:43:47.183857+0000","last_clean":"2020-11-20T11:43:47.183857+0000","last_became_active":"2020-11-20T11:18:02.983629+0000","last_became_peered":"2020-11-20T11:18:02.983629+0000","last_unstale":"2020-11-20T11:43:47.183857+0000","last_undegraded":"2020-11-20T11:43:47.183857+0000","last_fullsized":"2020-11-20T11:43:47.183857+0000","mapping_epoch":27,"log_start":"29'17744","ondisk_log_start":"29'17744","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27790","last_scrub_stamp":"2020-11-20T11:43:47.183851+0000","last_deep_scrub":"29'27790","last_deep_scrub_stamp":"2020-11-20T11:43:47.183851+0000","last_clean_scrub_stamp":"2020-11-20T11:43:47.183851+0000","log_size":10046,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1191,"num_read_kb":78290,"num_write":20463,"num_write_kb":728019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:38.529349+0000","last_change":"2020-11-20T11:43:38.529440+0000","last_active":"2020-11-20T11:43:38.529349+0000","last_peered":"2020-11-20T11:43:38.529349+0000","last_clean":"2020-11-20T11:43:38.529349+0000","last_became_active":"2020-11-20T11:17:56.684191+0000","last_became_peered":"2020-11-20T11:17:56.684191+0000","last_unstale":"2020-11-20T11:43:38.529349+0000","last_undegraded":"2020-11-20T11:43:38.529349+0000","last_fullsized":"2020-11-20T11:43:38.529349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:38.529344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:38.529344+0000","last_clean_scrub_stamp":"2020-11-20T11:43:38.529344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"29'23449","reported_seq":"23463","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:44.663275+0000","last_change":"2020-11-20T11:43:44.663337+0000","last_active":"2020-11-20T11:43:44.663275+0000","last_peered":"2020-11-20T11:43:44.663275+0000","last_clean":"2020-11-20T11:43:44.663275+0000","last_became_active":"2020-11-20T11:17:59.711776+0000","last_became_peered":"2020-11-20T11:17:59.711776+0000","last_unstale":"2020-11-20T11:43:44.663275+0000","last_undegraded":"2020-11-20T11:43:44.663275+0000","last_fullsized":"2020-11-20T11:43:44.663275+0000","mapping_epoch":24,"log_start":"29'13400","ondisk_log_start":"29'13400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23449","last_scrub_stamp":"2020-11-20T11:43:44.663269+0000","last_deep_scrub":"29'23449","last_deep_scrub_stamp":"2020-11-20T11:43:44.663269+0000","last_clean_scrub_stamp":"2020-11-20T11:43:44.663269+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":23462,"num_write_kb":165859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74568,"num_omap_keys":120,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"29'27745","reported_seq":"29901","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:55.532060+0000","last_change":"2020-11-20T11:43:55.532166+0000","last_active":"2020-11-20T11:43:55.532060+0000","last_peered":"2020-11-20T11:43:55.532060+0000","last_clean":"2020-11-20T11:43:55.532060+0000","last_became_active":"2020-11-20T11:18:02.983191+0000","last_became_peered":"2020-11-20T11:18:02.983191+0000","last_unstale":"2020-11-20T11:43:55.532060+0000","last_undegraded":"2020-11-20T11:43:55.532060+0000","last_fullsized":"2020-11-20T11:43:55.532060+0000","mapping_epoch":27,"log_start":"29'17730","ondisk_log_start":"29'17730","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27745","last_scrub_stamp":"2020-11-20T11:43:55.532054+0000","last_deep_scrub":"29'27745","last_deep_scrub_stamp":"2020-11-20T11:43:55.532054+0000","last_clean_scrub_stamp":"2020-11-20T11:43:55.532054+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2142,"num_read_kb":148296,"num_write":20457,"num_write_kb":686402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:42.464718+0000","last_change":"2020-11-20T11:43:42.464820+0000","last_active":"2020-11-20T11:43:42.464718+0000","last_peered":"2020-11-20T11:43:42.464718+0000","last_clean":"2020-11-20T11:43:42.464718+0000","last_became_active":"2020-11-20T11:17:56.596562+0000","last_became_peered":"2020-11-20T11:17:56.596562+0000","last_unstale":"2020-11-20T11:43:42.464718+0000","last_undegraded":"2020-11-20T11:43:42.464718+0000","last_fullsized":"2020-11-20T11:43:42.464718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:42.464713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:42.464713+0000","last_clean_scrub_stamp":"2020-11-20T11:43:42.464713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'21489","reported_seq":"21503","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:43.765493+0000","last_change":"2020-11-20T11:43:43.765572+0000","last_active":"2020-11-20T11:43:43.765493+0000","last_peered":"2020-11-20T11:43:43.765493+0000","last_clean":"2020-11-20T11:43:43.765493+0000","last_became_active":"2020-11-20T11:18:00.078417+0000","last_became_peered":"2020-11-20T11:18:00.078417+0000","last_unstale":"2020-11-20T11:43:43.765493+0000","last_undegraded":"2020-11-20T11:43:43.765493+0000","last_fullsized":"2020-11-20T11:43:43.765493+0000","mapping_epoch":24,"log_start":"29'11400","ondisk_log_start":"29'11400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21489","last_scrub_stamp":"2020-11-20T11:43:43.765488+0000","last_deep_scrub":"29'21489","last_deep_scrub_stamp":"2020-11-20T11:43:43.765488+0000","last_clean_scrub_stamp":"2020-11-20T11:43:43.765488+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943074,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":21508,"num_write_kb":159909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64624,"num_omap_keys":107,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"29'25905","reported_seq":"29321","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:59.538580+0000","last_change":"2020-11-20T11:43:59.538678+0000","last_active":"2020-11-20T11:43:59.538580+0000","last_peered":"2020-11-20T11:43:59.538580+0000","last_clean":"2020-11-20T11:43:59.538580+0000","last_became_active":"2020-11-20T11:18:02.983360+0000","last_became_peered":"2020-11-20T11:18:02.983360+0000","last_unstale":"2020-11-20T11:43:59.538580+0000","last_undegraded":"2020-11-20T11:43:59.538580+0000","last_fullsized":"2020-11-20T11:43:59.538580+0000","mapping_epoch":27,"log_start":"29'15875","ondisk_log_start":"29'15875","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25905","last_scrub_stamp":"2020-11-20T11:43:59.538574+0000","last_deep_scrub":"29'25905","last_deep_scrub_stamp":"2020-11-20T11:43:59.538574+0000","last_clean_scrub_stamp":"2020-11-20T11:43:59.538574+0000","log_size":10030,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3402,"num_read_kb":211712,"num_write":18641,"num_write_kb":503848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.640177+0000","last_change":"2020-11-20T11:43:40.640237+0000","last_active":"2020-11-20T11:43:40.640177+0000","last_peered":"2020-11-20T11:43:40.640177+0000","last_clean":"2020-11-20T11:43:40.640177+0000","last_became_active":"2020-11-20T11:17:56.649715+0000","last_became_peered":"2020-11-20T11:17:56.649715+0000","last_unstale":"2020-11-20T11:43:40.640177+0000","last_undegraded":"2020-11-20T11:43:40.640177+0000","last_fullsized":"2020-11-20T11:43:40.640177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.640173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.640173+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.640173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'18523","reported_seq":"18537","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:42.408599+0000","last_change":"2020-11-20T11:43:42.408682+0000","last_active":"2020-11-20T11:43:42.408599+0000","last_peered":"2020-11-20T11:43:42.408599+0000","last_clean":"2020-11-20T11:43:42.408599+0000","last_became_active":"2020-11-20T11:18:00.078469+0000","last_became_peered":"2020-11-20T11:18:00.078469+0000","last_unstale":"2020-11-20T11:43:42.408599+0000","last_undegraded":"2020-11-20T11:43:42.408599+0000","last_fullsized":"2020-11-20T11:43:42.408599+0000","mapping_epoch":24,"log_start":"29'8500","ondisk_log_start":"29'8500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18523","last_scrub_stamp":"2020-11-20T11:43:42.408593+0000","last_deep_scrub":"29'18523","last_deep_scrub_stamp":"2020-11-20T11:43:42.408593+0000","last_clean_scrub_stamp":"2020-11-20T11:43:42.408593+0000","log_size":10023,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":18571,"num_write_kb":134049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71471,"num_omap_keys":115,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"29'26715","reported_seq":"29059","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:50.488921+0000","last_change":"2020-11-20T11:43:50.489019+0000","last_active":"2020-11-20T11:43:50.488921+0000","last_peered":"2020-11-20T11:43:50.488921+0000","last_clean":"2020-11-20T11:43:50.488921+0000","last_became_active":"2020-11-20T11:18:02.734743+0000","last_became_peered":"2020-11-20T11:18:02.734743+0000","last_unstale":"2020-11-20T11:43:50.488921+0000","last_undegraded":"2020-11-20T11:43:50.488921+0000","last_fullsized":"2020-11-20T11:43:50.488921+0000","mapping_epoch":27,"log_start":"29'16620","ondisk_log_start":"29'16620","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26715","last_scrub_stamp":"2020-11-20T11:43:50.488915+0000","last_deep_scrub":"29'26715","last_deep_scrub_stamp":"2020-11-20T11:43:50.488915+0000","last_clean_scrub_stamp":"2020-11-20T11:43:50.488915+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":130128,"num_write":19349,"num_write_kb":649312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.673976+0000","last_change":"2020-11-20T11:43:39.674057+0000","last_active":"2020-11-20T11:43:39.673976+0000","last_peered":"2020-11-20T11:43:39.673976+0000","last_clean":"2020-11-20T11:43:39.673976+0000","last_became_active":"2020-11-20T11:17:56.679223+0000","last_became_peered":"2020-11-20T11:17:56.679223+0000","last_unstale":"2020-11-20T11:43:39.673976+0000","last_undegraded":"2020-11-20T11:43:39.673976+0000","last_fullsized":"2020-11-20T11:43:39.673976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:39.673970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:39.673970+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.673970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"29'6","reported_seq":"27","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.485225+0000","last_change":"2020-11-20T11:43:39.485296+0000","last_active":"2020-11-20T11:43:39.485225+0000","last_peered":"2020-11-20T11:43:39.485225+0000","last_clean":"2020-11-20T11:43:39.485225+0000","last_became_active":"2020-11-20T11:17:52.236657+0000","last_became_peered":"2020-11-20T11:17:52.236657+0000","last_unstale":"2020-11-20T11:43:39.485225+0000","last_undegraded":"2020-11-20T11:43:39.485225+0000","last_fullsized":"2020-11-20T11:43:39.485225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2020-11-20T11:43:39.485215+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2020-11-20T11:43:39.485215+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.485215+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12391,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'22081","reported_seq":"22096","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:38.923178+0000","last_change":"2020-11-20T11:43:38.923178+0000","last_active":"2020-11-20T11:43:38.923178+0000","last_peered":"2020-11-20T11:43:38.923178+0000","last_clean":"2020-11-20T11:43:38.923178+0000","last_became_active":"2020-11-20T11:17:59.712658+0000","last_became_peered":"2020-11-20T11:17:59.712658+0000","last_unstale":"2020-11-20T11:43:38.923178+0000","last_undegraded":"2020-11-20T11:43:38.923178+0000","last_fullsized":"2020-11-20T11:43:38.923178+0000","mapping_epoch":24,"log_start":"29'12000","ondisk_log_start":"29'12000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22080","last_scrub_stamp":"2020-11-20T11:43:38.923075+0000","last_deep_scrub":"29'22080","last_deep_scrub_stamp":"2020-11-20T11:43:38.923075+0000","last_clean_scrub_stamp":"2020-11-20T11:43:38.923075+0000","log_size":10081,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26168288,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22090,"num_write_kb":157240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60910,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'27059","reported_seq":"30149","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:53.268425+0000","last_change":"2020-11-20T11:43:53.268517+0000","last_active":"2020-11-20T11:43:53.268425+0000","last_peered":"2020-11-20T11:43:53.268425+0000","last_clean":"2020-11-20T11:43:53.268425+0000","last_became_active":"2020-11-20T11:18:02.983786+0000","last_became_peered":"2020-11-20T11:18:02.983786+0000","last_unstale":"2020-11-20T11:43:53.268425+0000","last_undegraded":"2020-11-20T11:43:53.268425+0000","last_fullsized":"2020-11-20T11:43:53.268425+0000","mapping_epoch":27,"log_start":"29'17048","ondisk_log_start":"29'17048","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27059","last_scrub_stamp":"2020-11-20T11:43:53.268418+0000","last_deep_scrub":"29'27059","last_deep_scrub_stamp":"2020-11-20T11:43:53.268418+0000","last_clean_scrub_stamp":"2020-11-20T11:43:53.268418+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3076,"num_read_kb":198434,"num_write":19655,"num_write_kb":812748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.480441+0000","last_change":"2020-11-20T11:43:40.480537+0000","last_active":"2020-11-20T11:43:40.480441+0000","last_peered":"2020-11-20T11:43:40.480441+0000","last_clean":"2020-11-20T11:43:40.480441+0000","last_became_active":"2020-11-20T11:17:56.679659+0000","last_became_peered":"2020-11-20T11:17:56.679659+0000","last_unstale":"2020-11-20T11:43:40.480441+0000","last_undegraded":"2020-11-20T11:43:40.480441+0000","last_fullsized":"2020-11-20T11:43:40.480441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.480436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.480436+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.480436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15589","reported_seq":"16576","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:45.750592+0000","last_change":"2020-11-20T11:43:45.750680+0000","last_active":"2020-11-20T11:43:45.750592+0000","last_peered":"2020-11-20T11:43:45.750592+0000","last_clean":"2020-11-20T11:43:45.750592+0000","last_became_active":"2020-11-20T11:18:00.078516+0000","last_became_peered":"2020-11-20T11:18:00.078516+0000","last_unstale":"2020-11-20T11:43:45.750592+0000","last_undegraded":"2020-11-20T11:43:45.750592+0000","last_fullsized":"2020-11-20T11:43:45.750592+0000","mapping_epoch":24,"log_start":"29'5500","ondisk_log_start":"29'5500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15589","last_scrub_stamp":"2020-11-20T11:43:45.750584+0000","last_deep_scrub":"29'15589","last_deep_scrub_stamp":"2020-11-20T11:43:45.750584+0000","last_clean_scrub_stamp":"2020-11-20T11:43:45.750584+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":974,"num_read_kb":4817,"num_write":15600,"num_write_kb":119720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22994,"num_omap_keys":37,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'26836","reported_seq":"28275","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:41.760121+0000","last_change":"2020-11-20T11:43:41.760218+0000","last_active":"2020-11-20T11:43:41.760121+0000","last_peered":"2020-11-20T11:43:41.760121+0000","last_clean":"2020-11-20T11:43:41.760121+0000","last_became_active":"2020-11-20T11:18:02.734738+0000","last_became_peered":"2020-11-20T11:18:02.734738+0000","last_unstale":"2020-11-20T11:43:41.760121+0000","last_undegraded":"2020-11-20T11:43:41.760121+0000","last_fullsized":"2020-11-20T11:43:41.760121+0000","mapping_epoch":27,"log_start":"29'16815","ondisk_log_start":"29'16815","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26836","last_scrub_stamp":"2020-11-20T11:43:41.760115+0000","last_deep_scrub":"29'26836","last_deep_scrub_stamp":"2020-11-20T11:43:41.760115+0000","last_clean_scrub_stamp":"2020-11-20T11:43:41.760115+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1425,"num_read_kb":95802,"num_write":19396,"num_write_kb":604990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:45.130079+0000","last_change":"2020-11-20T11:43:45.130180+0000","last_active":"2020-11-20T11:43:45.130079+0000","last_peered":"2020-11-20T11:43:45.130079+0000","last_clean":"2020-11-20T11:43:45.130079+0000","last_became_active":"2020-11-20T11:17:56.678081+0000","last_became_peered":"2020-11-20T11:17:56.678081+0000","last_unstale":"2020-11-20T11:43:45.130079+0000","last_undegraded":"2020-11-20T11:43:45.130079+0000","last_fullsized":"2020-11-20T11:43:45.130079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:45.130072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:45.130072+0000","last_clean_scrub_stamp":"2020-11-20T11:43:45.130072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"29'21577","reported_seq":"22100","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:50.716775+0000","last_change":"2020-11-20T11:43:50.716836+0000","last_active":"2020-11-20T11:43:50.716775+0000","last_peered":"2020-11-20T11:43:50.716775+0000","last_clean":"2020-11-20T11:43:50.716775+0000","last_became_active":"2020-11-20T11:18:00.078496+0000","last_became_peered":"2020-11-20T11:18:00.078496+0000","last_unstale":"2020-11-20T11:43:50.716775+0000","last_undegraded":"2020-11-20T11:43:50.716775+0000","last_fullsized":"2020-11-20T11:43:50.716775+0000","mapping_epoch":24,"log_start":"29'11500","ondisk_log_start":"29'11500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21577","last_scrub_stamp":"2020-11-20T11:43:50.716769+0000","last_deep_scrub":"29'21577","last_deep_scrub_stamp":"2020-11-20T11:43:50.716769+0000","last_clean_scrub_stamp":"2020-11-20T11:43:50.716769+0000","log_size":10077,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53257703,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":512,"num_read_kb":3197,"num_write":21592,"num_write_kb":163023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59659,"num_omap_keys":96,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"29'27800","reported_seq":"30322","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:55.119644+0000","last_change":"2020-11-20T11:43:55.119742+0000","last_active":"2020-11-20T11:43:55.119644+0000","last_peered":"2020-11-20T11:43:55.119644+0000","last_clean":"2020-11-20T11:43:55.119644+0000","last_became_active":"2020-11-20T11:18:02.983529+0000","last_became_peered":"2020-11-20T11:18:02.983529+0000","last_unstale":"2020-11-20T11:43:55.119644+0000","last_undegraded":"2020-11-20T11:43:55.119644+0000","last_fullsized":"2020-11-20T11:43:55.119644+0000","mapping_epoch":27,"log_start":"29'17742","ondisk_log_start":"29'17742","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27800","last_scrub_stamp":"2020-11-20T11:43:55.119638+0000","last_deep_scrub":"29'27800","last_deep_scrub_stamp":"2020-11-20T11:43:55.119638+0000","last_clean_scrub_stamp":"2020-11-20T11:43:55.119638+0000","log_size":10058,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2508,"num_read_kb":194578,"num_write":20501,"num_write_kb":678922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'12672","reported_seq":"13406","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:51.144034+0000","last_change":"2020-11-20T11:43:51.144096+0000","last_active":"2020-11-20T11:43:51.144034+0000","last_peered":"2020-11-20T11:43:51.144034+0000","last_clean":"2020-11-20T11:43:51.144034+0000","last_became_active":"2020-11-20T11:18:00.078506+0000","last_became_peered":"2020-11-20T11:18:00.078506+0000","last_unstale":"2020-11-20T11:43:51.144034+0000","last_undegraded":"2020-11-20T11:43:51.144034+0000","last_fullsized":"2020-11-20T11:43:51.144034+0000","mapping_epoch":24,"log_start":"29'2600","ondisk_log_start":"29'2600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12672","last_scrub_stamp":"2020-11-20T11:43:51.144028+0000","last_deep_scrub":"29'12672","last_deep_scrub_stamp":"2020-11-20T11:43:51.144028+0000","last_clean_scrub_stamp":"2020-11-20T11:43:51.144028+0000","log_size":10072,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20972095,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":722,"num_read_kb":4571,"num_write":12694,"num_write_kb":97715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121809,"num_omap_keys":196,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.535833+0000","last_change":"2020-11-20T11:43:39.535915+0000","last_active":"2020-11-20T11:43:39.535833+0000","last_peered":"2020-11-20T11:43:39.535833+0000","last_clean":"2020-11-20T11:43:39.535833+0000","last_became_active":"2020-11-20T11:17:56.593934+0000","last_became_peered":"2020-11-20T11:17:56.593934+0000","last_unstale":"2020-11-20T11:43:39.535833+0000","last_undegraded":"2020-11-20T11:43:39.535833+0000","last_fullsized":"2020-11-20T11:43:39.535833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:39.535828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:39.535828+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.535828+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"29'27006","reported_seq":"28346","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:41.102277+0000","last_change":"2020-11-20T11:43:41.102398+0000","last_active":"2020-11-20T11:43:41.102277+0000","last_peered":"2020-11-20T11:43:41.102277+0000","last_clean":"2020-11-20T11:43:41.102277+0000","last_became_active":"2020-11-20T11:18:02.983867+0000","last_became_peered":"2020-11-20T11:18:02.983867+0000","last_unstale":"2020-11-20T11:43:41.102277+0000","last_undegraded":"2020-11-20T11:43:41.102277+0000","last_fullsized":"2020-11-20T11:43:41.102277+0000","mapping_epoch":27,"log_start":"29'16957","ondisk_log_start":"29'16957","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27006","last_scrub_stamp":"2020-11-20T11:43:41.102270+0000","last_deep_scrub":"29'27006","last_deep_scrub_stamp":"2020-11-20T11:43:41.102270+0000","last_clean_scrub_stamp":"2020-11-20T11:43:41.102270+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1326,"num_read_kb":63596,"num_write":19698,"num_write_kb":703697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:40.640884+0000","last_change":"2020-11-20T11:43:40.640965+0000","last_active":"2020-11-20T11:43:40.640884+0000","last_peered":"2020-11-20T11:43:40.640884+0000","last_clean":"2020-11-20T11:43:40.640884+0000","last_became_active":"2020-11-20T11:17:56.681675+0000","last_became_peered":"2020-11-20T11:17:56.681675+0000","last_unstale":"2020-11-20T11:43:40.640884+0000","last_undegraded":"2020-11-20T11:43:40.640884+0000","last_fullsized":"2020-11-20T11:43:40.640884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:43:40.640872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:43:40.640872+0000","last_clean_scrub_stamp":"2020-11-20T11:43:40.640872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'19992","reported_seq":"20006","reported_epoch":"29","state":"active+clean","last_fresh":"2020-11-20T11:43:39.192700+0000","last_change":"2020-11-20T11:43:39.192755+0000","last_active":"2020-11-20T11:43:39.192700+0000","last_peered":"2020-11-20T11:43:39.192700+0000","last_clean":"2020-11-20T11:43:39.192700+0000","last_became_active":"2020-11-20T11:17:59.711673+0000","last_became_peered":"2020-11-20T11:17:59.711673+0000","last_unstale":"2020-11-20T11:43:39.192700+0000","last_undegraded":"2020-11-20T11:43:39.192700+0000","last_fullsized":"2020-11-20T11:43:39.192700+0000","mapping_epoch":24,"log_start":"29'9900","ondisk_log_start":"29'9900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19992","last_scrub_stamp":"2020-11-20T11:43:39.192696+0000","last_deep_scrub":"29'19992","last_deep_scrub_stamp":"2020-11-20T11:43:39.192696+0000","last_clean_scrub_stamp":"2020-11-20T11:43:39.192696+0000","log_size":10092,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":20597,"num_write_kb":146710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112475,"num_omap_keys":181,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17400,"num_read_kb":1120836,"num_write":158160,"num_write_kb":5367938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80325,"ondisk_log_size":80325,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":251393224,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":2223,"num_read_kb":12585,"num_write":156114,"num_write_kb":1144225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588510,"num_omap_keys":950,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":502849536,"data_stored":502786448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80572,"ondisk_log_size":80572,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12391,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":8,"up_from":18,"seq":77309411648,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109424,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":109120,"kb_avail":94262416,"statfs":{"total":96636764160,"available":96524713984,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111738880},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.6930000000000001,"15min":1.2769999999999999},"min":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":60.896000000000001,"15min":60.896000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.8120000000000001,"15min":1.351},"min":{"1min":0.63100000000000001,"5min":0.57199999999999995,"15min":0.56899999999999995},"max":{"1min":2.5950000000000002,"5min":64.224000000000004,"15min":64.224000000000004},"last":0.91400000000000003}]},{"osd":1,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1639999999999999,"15min":1.151},"min":{"1min":0.68999999999999995,"5min":0.59299999999999997,"15min":0.56999999999999995},"max":{"1min":3.536,"5min":5.4260000000000002,"15min":11.624000000000001},"last":1.173},{"interface":"front","average":{"1min":1.087,"5min":1.25,"15min":1.2669999999999999},"min":{"1min":0.79100000000000004,"5min":0.59999999999999998,"15min":0.46600000000000003},"max":{"1min":1.5209999999999999,"5min":6.2240000000000002,"15min":6.375},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.464,"15min":1.278},"min":{"1min":0.66500000000000004,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":4.9950000000000001,"5min":9.5730000000000004,"15min":11.711},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.341,"5min":1.506,"15min":1.3999999999999999},"min":{"1min":0.79400000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.4079999999999999,"5min":9.5120000000000005,"15min":10.047000000000001},"last":0.878}]},{"osd":3,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.708,"5min":2.177,"15min":1.833},"min":{"1min":0.79700000000000004,"5min":0.75,"15min":0.61899999999999999},"max":{"1min":6.2400000000000002,"5min":41.573999999999998,"15min":41.573999999999998},"last":1.276},{"interface":"front","average":{"1min":1.575,"5min":2.1160000000000001,"15min":1.6870000000000001},"min":{"1min":0.83799999999999997,"5min":0.79100000000000004,"15min":0.60299999999999998},"max":{"1min":3.7810000000000001,"5min":46.341999999999999,"15min":46.341999999999999},"last":1.3320000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.512,"15min":1.46},"min":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.626},"max":{"1min":3.5409999999999999,"5min":7.0259999999999998,"15min":7.3819999999999997},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.623,"15min":1.651},"min":{"1min":1.0029999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7549999999999999,"5min":9.7059999999999995,"15min":9.7059999999999995},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.8490000000000002,"15min":2.1040000000000001},"min":{"1min":1.0229999999999999,"5min":0.85999999999999999,"15min":0.85699999999999998},"max":{"1min":7.1459999999999999,"5min":22.707999999999998,"15min":22.707999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":2.339,"5min":3.0470000000000002,"15min":2.1560000000000001},"min":{"1min":1.0900000000000001,"5min":0.96199999999999997,"15min":0.76600000000000001},"max":{"1min":5.6559999999999997,"5min":21.841999999999999,"15min":21.841999999999999},"last":1.448}]},{"osd":7,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.7669999999999999,"15min":1.8220000000000001},"min":{"1min":1.1539999999999999,"5min":0.97399999999999998,"15min":0.88300000000000001},"max":{"1min":4.298,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.742,"5min":1.8819999999999999,"15min":1.788},"min":{"1min":1.1060000000000001,"5min":0.96299999999999997,"15min":0.72199999999999998},"max":{"1min":3.907,"5min":6.5750000000000002,"15min":12.638999999999999},"last":1.6639999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.9239999999999999,"15min":1.8280000000000001},"min":{"1min":1.1699999999999999,"5min":1.0229999999999999,"15min":0.99299999999999999},"max":{"1min":3.9079999999999999,"5min":7.1470000000000002,"15min":9.8529999999999998},"last":1.585},{"interface":"front","average":{"1min":1.798,"5min":1.919,"15min":1.9450000000000001},"min":{"1min":1.226,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.8980000000000001,"5min":7.5810000000000004,"15min":10.669},"last":1.571}]},{"osd":10,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":2.056,"15min":1.8779999999999999},"min":{"1min":1.258,"5min":1.1040000000000001,"15min":1.0680000000000001},"max":{"1min":5.5259999999999998,"5min":7.3390000000000004,"15min":12.757},"last":1.784},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.806},"min":{"1min":1.24,"5min":1.105,"15min":0.98099999999999998},"max":{"1min":3.6669999999999998,"5min":7.4139999999999997,"15min":7.8620000000000001},"last":1.7090000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:43 2020","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":1.875,"15min":1.8959999999999999},"min":{"1min":1.2889999999999999,"5min":1.109,"15min":1.0760000000000001},"max":{"1min":5.6420000000000003,"5min":7.8179999999999996,"15min":7.8179999999999996},"last":1.6439999999999999},{"interface":"front","average":{"1min":2.0009999999999999,"5min":2.2080000000000002,"15min":2.0249999999999999},"min":{"1min":1.3280000000000001,"5min":1.099,"15min":1.079},"max":{"1min":4.9960000000000004,"5min":7.1849999999999996,"15min":12.827},"last":1.8580000000000001}]}]},{"osd":7,"up_from":18,"seq":77309411648,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192688,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":192384,"kb_avail":94179152,"statfs":{"total":96636764160,"available":96439451648,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":197001216},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1579999999999999,"15min":1.173},"min":{"1min":0.70099999999999996,"5min":0.48999999999999999,"15min":0.45400000000000001},"max":{"1min":4.298,"5min":5.4560000000000004,"15min":10.59},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.3029999999999999,"15min":1.296},"min":{"1min":0.66400000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.782,"5min":15.769,"15min":15.769},"last":0.754}]},{"osd":1,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1759999999999999,"15min":1.2370000000000001},"min":{"1min":0.68799999999999994,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.8079999999999998,"5min":6.8079999999999998,"15min":8.5679999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.399,"5min":1.339,"15min":1.4930000000000001},"min":{"1min":0.85399999999999998,"5min":0.63800000000000001,"15min":0.503},"max":{"1min":5.1959999999999997,"5min":6.7910000000000004,"15min":9.0530000000000008},"last":1.323}]},{"osd":2,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.3899999999999999,"15min":1.361},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0419999999999998,"5min":7.5899999999999999,"15min":7.5899999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.5660000000000001,"15min":1.474},"min":{"1min":0.70099999999999996,"5min":0.65900000000000003,"15min":0.50600000000000001},"max":{"1min":6.3490000000000002,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":1.46}]},{"osd":3,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.6020000000000001,"15min":1.552},"min":{"1min":0.90800000000000003,"5min":0.65600000000000003,"15min":0.61699999999999999},"max":{"1min":4.5609999999999999,"5min":8.6660000000000004,"15min":8.6660000000000004},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.605,"15min":1.6359999999999999},"min":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.68799999999999994},"max":{"1min":1.4790000000000001,"5min":7.4459999999999997,"15min":8.8209999999999997},"last":1.05}]},{"osd":5,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.6579999999999999,"15min":1.635},"min":{"1min":0.80800000000000005,"5min":0.69299999999999995,"15min":0.67400000000000004},"max":{"1min":4.4509999999999996,"5min":9.0139999999999993,"15min":10.208},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.702,"5min":1.7929999999999999,"15min":1.6579999999999999},"min":{"1min":1.0429999999999999,"5min":0.84199999999999997,"15min":0.73399999999999999},"max":{"1min":6.702,"5min":12.459,"15min":12.459},"last":1.292}]},{"osd":6,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":2.5960000000000001,"15min":2.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.73199999999999998,"15min":0.69299999999999995},"max":{"1min":6.5910000000000002,"5min":24.305,"15min":24.305},"last":1.143},{"interface":"front","average":{"1min":1.6180000000000001,"5min":2.7400000000000002,"15min":2.2679999999999998},"min":{"1min":1.2230000000000001,"5min":1.0169999999999999,"15min":0.86899999999999999},"max":{"1min":4.6769999999999996,"5min":24.324999999999999,"15min":24.324999999999999},"last":1.486}]},{"osd":8,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.7529999999999999,"15min":1.7330000000000001},"min":{"1min":1.0620000000000001,"5min":0.93100000000000005,"15min":0.69799999999999995},"max":{"1min":1.919,"5min":7.7149999999999999,"15min":8.3170000000000002},"last":1.446},{"interface":"front","average":{"1min":1.8640000000000001,"5min":1.9350000000000001,"15min":1.845},"min":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":0.83499999999999996},"max":{"1min":6.9370000000000003,"5min":6.9370000000000003,"15min":8.4949999999999992},"last":1.603}]},{"osd":9,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":2.1400000000000001,"15min":2.2799999999999998},"min":{"1min":1.3999999999999999,"5min":0.96999999999999997,"15min":0.84799999999999998},"max":{"1min":7.1479999999999997,"5min":8.4589999999999996,"15min":56.667999999999999},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.966,"15min":2.1970000000000001},"min":{"1min":1.236,"5min":1.018,"15min":0.94999999999999996},"max":{"1min":4.7880000000000003,"5min":8.0700000000000003,"15min":55.774000000000001},"last":1.6279999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.8540000000000001,"15min":1.8260000000000001},"min":{"1min":1.276,"5min":1.034,"15min":0.71499999999999997},"max":{"1min":6.7629999999999999,"5min":7.835,"15min":7.835},"last":1.353},{"interface":"front","average":{"1min":2.0339999999999998,"5min":2.0350000000000001,"15min":2.0390000000000001},"min":{"1min":1.4790000000000001,"5min":1.167,"15min":0.89000000000000001},"max":{"1min":7.048,"5min":7.657,"15min":17.899000000000001},"last":1.75}]},{"osd":11,"last update":"Fri Nov 20 11:44:01 2020","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.988,"15min":2.0070000000000001},"min":{"1min":1.4079999999999999,"5min":1.097,"15min":0.98199999999999998},"max":{"1min":4.8570000000000002,"5min":7.9459999999999997,"15min":10.467000000000001},"last":1.782},{"interface":"front","average":{"1min":1.603,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":1.351,"5min":1.147,"15min":0.99299999999999999},"max":{"1min":2.0019999999999998,"5min":8.2260000000000009,"15min":8.4359999999999999},"last":1.522}]}]},{"osd":1,"up_from":18,"seq":77309411647,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102192,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":101888,"kb_avail":94269648,"statfs":{"total":96636764160,"available":96532119552,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104333312},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.139,"15min":1.0169999999999999},"min":{"1min":0.59599999999999997,"5min":0.56599999999999995,"15min":0.55000000000000004},"max":{"1min":4.8959999999999999,"5min":4.8959999999999999,"15min":6.5350000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.4870000000000001,"15min":1.413},"min":{"1min":0.84599999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":5.0030000000000001,"5min":5.0030000000000001,"15min":6.649},"last":1.105}]},{"osd":2,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.145,"15min":1.323},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.56299999999999994},"max":{"1min":3.2130000000000001,"5min":6.9470000000000001,"15min":29.122},"last":1.056},{"interface":"front","average":{"1min":1.169,"5min":1.0669999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3879999999999999,"15min":1.6899999999999999},"min":{"1min":0.74099999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"max":{"1min":3.3050000000000002,"5min":4.5640000000000001,"15min":69.046000000000006},"last":0.746},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3600000000000001,"15min":1.6839999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.476,"5min":5.0030000000000001,"15min":69.950000000000003},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.361,"15min":1.3620000000000001},"min":{"1min":0.80100000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.4220000000000002,"5min":4.4779999999999998,"15min":6.3419999999999996},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.448,"15min":1.5309999999999999},"min":{"1min":0.92800000000000005,"5min":0.70399999999999996,"15min":0.66600000000000004},"max":{"1min":3.282,"5min":7.1079999999999997,"15min":7.1079999999999997},"last":1.206}]},{"osd":5,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.462,"15min":1.496},"min":{"1min":0.70599999999999996,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.9939999999999998,"5min":5.1420000000000003,"15min":9.8879999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.7190000000000001,"5min":1.6200000000000001,"15min":1.5620000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":4.867,"5min":4.867,"15min":5.8700000000000001},"last":1.355}]},{"osd":6,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.972,"5min":2.6619999999999999,"15min":2.4049999999999998},"min":{"1min":1.0109999999999999,"5min":0.91700000000000004,"15min":0.84799999999999998},"max":{"1min":5.6669999999999998,"5min":47.176000000000002,"15min":69.305999999999997},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.617,"5min":2.1070000000000002,"15min":1.9079999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":4.0739999999999998,"5min":19.556000000000001,"15min":19.556000000000001},"last":1.27}]},{"osd":7,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.736,"15min":1.72},"min":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.92200000000000004},"max":{"1min":2.4860000000000002,"5min":5.46,"15min":7.5789999999999997},"last":1.452},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.7330000000000001,"15min":1.7929999999999999},"min":{"1min":1.105,"5min":0.98299999999999998,"15min":0.92000000000000004},"max":{"1min":3.52,"5min":4.3310000000000004,"15min":7.4699999999999998},"last":1.518}]},{"osd":8,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.7490000000000001,"15min":1.7310000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.8959999999999999,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.381},{"interface":"front","average":{"1min":1.724,"5min":1.889,"15min":1.8049999999999999},"min":{"1min":1.1739999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":4.4320000000000004,"5min":5.056,"15min":5.452},"last":1.7030000000000001}]},{"osd":9,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":2.516,"15min":2.161},"min":{"1min":1.151,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.411,"5min":47.082000000000001,"15min":47.082000000000001},"last":1.546},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.4820000000000002,"15min":2.1440000000000001},"min":{"1min":1.091,"5min":1.0720000000000001,"15min":1.028},"max":{"1min":4.2690000000000001,"5min":47.012999999999998,"15min":47.012999999999998},"last":1.425}]},{"osd":11,"last update":"Fri Nov 20 11:43:42 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.8360000000000001,"15min":1.847},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":4.516,"5min":5.008,"15min":8.5109999999999992},"last":1.474},{"interface":"front","average":{"1min":1.9279999999999999,"5min":2.677,"15min":2.2050000000000001},"min":{"1min":1.282,"5min":1.2330000000000001,"15min":1.1459999999999999},"max":{"1min":4.5739999999999998,"5min":47.206000000000003,"15min":47.206000000000003},"last":1.623}]}]},{"osd":11,"up_from":18,"seq":77309411648,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241912,"kb_used_data":20784,"kb_used_omap":0,"kb_used_meta":221120,"kb_avail":94129928,"statfs":{"total":96636764160,"available":96389046272,"internally_reserved":0,"allocated":21282816,"data_stored":21110376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":226426880},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.1779999999999999,"15min":1.155},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.5980000000000008,"5min":9.5980000000000008,"15min":9.5980000000000008},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.1579999999999999,"15min":1.246},"min":{"1min":0.73399999999999999,"5min":0.56699999999999995,"15min":0.55900000000000005},"max":{"1min":3.9969999999999999,"5min":8.9870000000000001,"15min":11.206},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":4.0979999999999999,"15min":2.0499999999999998},"min":{"1min":0.65300000000000002,"5min":0.58499999999999996,"15min":0.53000000000000003},"max":{"1min":2.1989999999999998,"5min":310.21100000000001,"15min":310.21100000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":4.2830000000000004,"15min":2.2989999999999999},"min":{"1min":0.93799999999999994,"5min":0.625,"15min":0.54700000000000004},"max":{"1min":5.7050000000000001,"5min":310.233,"15min":310.233},"last":1.3100000000000001}]},{"osd":2,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.206,"15min":1.2390000000000001},"min":{"1min":0.69199999999999995,"5min":0.627,"15min":0.54400000000000004},"max":{"1min":2.968,"5min":5.7220000000000004,"15min":6.7220000000000004},"last":1.365},{"interface":"front","average":{"1min":1.208,"5min":1.4079999999999999,"15min":1.3360000000000001},"min":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.69099999999999995},"max":{"1min":1.744,"5min":6.3550000000000004,"15min":6.9199999999999999},"last":1.1499999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.7969999999999999,"15min":1.681},"min":{"1min":0.95399999999999996,"5min":0.71399999999999997,"15min":0.625},"max":{"1min":5.3540000000000001,"5min":8.7300000000000004,"15min":15.169},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.865,"5min":1.855,"15min":1.8440000000000001},"min":{"1min":1.1319999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":5.3170000000000002,"5min":8.6950000000000003,"15min":20.972000000000001},"last":1.093}]},{"osd":4,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":4.5640000000000001,"15min":2.4260000000000002},"min":{"1min":0.77200000000000002,"5min":0.68300000000000005,"15min":0.60199999999999998},"max":{"1min":2.093,"5min":310.73899999999998,"15min":310.73899999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.8200000000000001,"5min":4.6799999999999997,"15min":2.6040000000000001},"min":{"1min":0.96099999999999997,"5min":0.90300000000000002,"15min":0.79800000000000004},"max":{"1min":5.8319999999999999,"5min":309.93700000000001,"15min":309.93700000000001},"last":1.4410000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.7609999999999999,"15min":1.7370000000000001},"min":{"1min":0.999,"5min":0.86899999999999999,"15min":0.79700000000000004},"max":{"1min":3.8919999999999999,"5min":5.6100000000000003,"15min":7.3010000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.9179999999999999,"15min":1.7949999999999999},"min":{"1min":0.997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":4.0949999999999998,"5min":7.5919999999999996,"15min":7.7649999999999997},"last":1.4810000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":2.121,"15min":1.9590000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83899999999999997},"max":{"1min":3.5800000000000001,"5min":8.9239999999999995,"15min":11.238},"last":1.286},{"interface":"front","average":{"1min":2.1739999999999999,"5min":2.1970000000000001,"15min":2.0169999999999999},"min":{"1min":1.107,"5min":0.97699999999999998,"15min":0.91800000000000004},"max":{"1min":6.8890000000000002,"5min":9.952,"15min":11.032},"last":1.5840000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":4.7649999999999997,"15min":2.9380000000000002},"min":{"1min":1.3380000000000001,"5min":1.0880000000000001,"15min":0.753},"max":{"1min":4.2000000000000002,"5min":310.26100000000002,"15min":310.26100000000002},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.619,"5min":5.0330000000000004,"15min":3.0470000000000002},"min":{"1min":1.2390000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3370000000000002,"5min":313.202,"15min":313.202},"last":1.3999999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.9750000000000001,"15min":1.9370000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":6.5129999999999999,"5min":8.7349999999999994,"15min":11.145},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.881,"5min":1.877,"15min":1.869},"min":{"1min":1.2649999999999999,"5min":1.1499999999999999,"15min":0.84599999999999997},"max":{"1min":5.2039999999999997,"5min":5.9260000000000002,"15min":8.4100000000000001},"last":1.7669999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":4.9089999999999998,"15min":2.8809999999999998},"min":{"1min":1.218,"5min":1.069,"15min":1.069},"max":{"1min":6.6379999999999999,"5min":311.82799999999997,"15min":311.82799999999997},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.802,"5min":4.7949999999999999,"15min":2.8410000000000002},"min":{"1min":1.403,"5min":1.2210000000000001,"15min":1.0880000000000001},"max":{"1min":3.1840000000000002,"5min":310.40800000000002,"15min":310.40800000000002},"last":1.6439999999999999}]}]},{"osd":10,"up_from":18,"seq":77309411648,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":522364,"kb_used_data":65844,"kb_used_omap":0,"kb_used_meta":456512,"kb_avail":93849476,"statfs":{"total":96636764160,"available":96101863424,"internally_reserved":0,"allocated":67424256,"data_stored":67247339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":467468288},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.3240000000000001},"min":{"1min":0.69099999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.577,"5min":17.451000000000001,"15min":17.451000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.5920000000000001,"15min":1.407},"min":{"1min":0.75900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":3.3679999999999999,"5min":17.646000000000001,"15min":17.646000000000001},"last":1.083}]},{"osd":1,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1140000000000001,"15min":1.1319999999999999},"min":{"1min":0.71599999999999997,"5min":0.60099999999999998,"15min":0.59699999999999998},"max":{"1min":1.2509999999999999,"5min":14.58,"15min":14.58},"last":1.042},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.52,"15min":1.4350000000000001},"min":{"1min":0.63300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.948,"5min":16.050999999999998,"15min":16.050999999999998},"last":1.409}]},{"osd":2,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.2629999999999999,"15min":1.3500000000000001},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4700000000000002,"5min":5.1550000000000002,"15min":27},"last":1.804},{"interface":"front","average":{"1min":1.212,"5min":1.2669999999999999,"15min":1.3300000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64800000000000002},"max":{"1min":1.6240000000000001,"5min":4.391,"15min":9.8219999999999992},"last":1.52}]},{"osd":3,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.819,"15min":1.5589999999999999},"min":{"1min":0.83699999999999997,"5min":0.73899999999999999,"15min":0.68500000000000005},"max":{"1min":3.9489999999999998,"5min":15.452999999999999,"15min":15.452999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.7210000000000001,"15min":1.7050000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.69799999999999995},"max":{"1min":2.113,"5min":5.2789999999999999,"15min":16.129999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.617,"15min":1.5509999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.76500000000000001},"max":{"1min":2.8559999999999999,"5min":6.0940000000000003,"15min":7.3049999999999997},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.5549999999999999,"15min":1.5629999999999999},"min":{"1min":1.0229999999999999,"5min":0.93600000000000005,"15min":0.71999999999999997},"max":{"1min":2.048,"5min":7.2119999999999997,"15min":9.3699999999999992},"last":1.6890000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.952,"15min":1.893},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.745},"max":{"1min":3.097,"5min":15.561,"15min":40.746000000000002},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.889,"15min":1.8169999999999999},"min":{"1min":0.93899999999999995,"5min":0.92100000000000004,"15min":0.64900000000000002},"max":{"1min":2.702,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":1.946}]},{"osd":6,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":2.706,"15min":2.1629999999999998},"min":{"1min":1.1659999999999999,"5min":1.1060000000000001,"15min":0.91800000000000004},"max":{"1min":6.843,"5min":21.189,"15min":21.189},"last":2.2530000000000001},{"interface":"front","average":{"1min":1.97,"5min":2.9319999999999999,"15min":2.286},"min":{"1min":1.244,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":7.0860000000000003,"5min":22.416,"15min":22.416},"last":1.7390000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":2.0579999999999998,"15min":1.958},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":0.97799999999999998},"max":{"1min":2.5950000000000002,"5min":9.4939999999999998,"15min":18.797999999999998},"last":2.0950000000000002},{"interface":"front","average":{"1min":1.597,"5min":1.764,"15min":1.8260000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.008},"max":{"1min":2.4409999999999998,"5min":6.7699999999999996,"15min":9.6400000000000006},"last":1.974}]},{"osd":9,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.9490000000000001,"15min":1.9550000000000001},"min":{"1min":1.266,"5min":1.2390000000000001,"15min":1.143},"max":{"1min":2.52,"5min":9.9090000000000007,"15min":9.9090000000000007},"last":1.839},{"interface":"front","average":{"1min":1.7869999999999999,"5min":2.121,"15min":2.0699999999999998},"min":{"1min":1.153,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":3.3250000000000002,"5min":15.627000000000001,"15min":15.627000000000001},"last":1.6559999999999999}]},{"osd":11,"last update":"Fri Nov 20 11:43:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.1619999999999999,"15min":2.1179999999999999},"min":{"1min":1.264,"5min":1.1539999999999999,"15min":1.044},"max":{"1min":2.8159999999999998,"5min":6.8970000000000002,"15min":10.279},"last":2.2290000000000001},{"interface":"front","average":{"1min":1.7050000000000001,"5min":1.8200000000000001,"15min":1.9339999999999999},"min":{"1min":1.339,"5min":1.081,"15min":1.081},"max":{"1min":2.2829999999999999,"5min":5.0510000000000002,"15min":10.076000000000001},"last":2.1200000000000001}]}]},{"osd":9,"up_from":18,"seq":77309411647,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153136,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":152832,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":303104,"data_stored":138281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":156499968},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5860000000000001,"15min":1.522},"min":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":4.8869999999999996,"5min":8.0500000000000007,"15min":14.436},"last":0.875},{"interface":"front","average":{"1min":1.125,"5min":1.677,"15min":1.5049999999999999},"min":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.56299999999999994},"max":{"1min":2.181,"5min":7.2480000000000002,"15min":14.875999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.573,"15min":1.357},"min":{"1min":0.70199999999999996,"5min":0.61299999999999999,"15min":0.58099999999999996},"max":{"1min":4.5499999999999998,"5min":6.8410000000000002,"15min":6.8410000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.6399999999999999,"15min":1.5549999999999999},"min":{"1min":0.71799999999999997,"5min":0.66500000000000004,"15min":0.66400000000000003},"max":{"1min":3.145,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.579}]},{"osd":2,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.9430000000000001,"15min":1.946},"min":{"1min":0.73599999999999999,"5min":0.67600000000000005,"15min":0.52800000000000002},"max":{"1min":4.3230000000000004,"5min":7.1449999999999996,"15min":67.947000000000003},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.74,"5min":2.0470000000000002,"15min":1.901},"min":{"1min":0.79700000000000004,"5min":0.71399999999999997,"15min":0.66300000000000003},"max":{"1min":4.6760000000000002,"5min":11.935,"15min":67.694999999999993},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.0150000000000001,"15min":1.9810000000000001},"min":{"1min":0.82399999999999995,"5min":0.69799999999999995,"15min":0.68200000000000005},"max":{"1min":4.4160000000000004,"5min":7.4960000000000004,"15min":27.167000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":2.2549999999999999,"15min":2.3639999999999999},"min":{"1min":0.95899999999999996,"5min":0.65900000000000003,"15min":0.65800000000000003},"max":{"1min":2.5750000000000002,"5min":7.4420000000000002,"15min":50.762},"last":1.367}]},{"osd":4,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.99,"15min":1.895},"min":{"1min":1.0269999999999999,"5min":0.89400000000000002,"15min":0.72599999999999998},"max":{"1min":4.5759999999999996,"5min":6.7350000000000003,"15min":7.3529999999999998},"last":1.452},{"interface":"front","average":{"1min":1.6659999999999999,"5min":2.222,"15min":1.9770000000000001},"min":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.77500000000000002},"max":{"1min":2.4689999999999999,"5min":7.0170000000000003,"15min":7.0170000000000003},"last":1.5129999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.2069999999999999,"5min":2.1739999999999999,"15min":2.25},"min":{"1min":1.319,"5min":1.0680000000000001,"15min":0.97799999999999998},"max":{"1min":4.4909999999999997,"5min":6.8559999999999999,"15min":66.474000000000004},"last":1.337},{"interface":"front","average":{"1min":1.954,"5min":2.399,"15min":2.387},"min":{"1min":1.119,"5min":1.071,"15min":0.82799999999999996},"max":{"1min":4.5259999999999998,"5min":7.1849999999999996,"15min":66.432000000000002},"last":1.645}]},{"osd":6,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":4.8209999999999997,"5min":3.8109999999999999,"15min":3.4849999999999999},"min":{"1min":1.1439999999999999,"5min":0.89800000000000002,"15min":0.79000000000000004},"max":{"1min":31.984999999999999,"5min":31.984999999999999,"15min":177.542},"last":1.2889999999999999},{"interface":"front","average":{"1min":4.282,"5min":3.8170000000000002,"15min":3.641},"min":{"1min":1.4890000000000001,"5min":1.3080000000000001,"15min":1.1180000000000001},"max":{"1min":23.193000000000001,"5min":23.193000000000001,"15min":178.292},"last":1.7030000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.157,"5min":2.4209999999999998,"15min":2.4249999999999998},"min":{"1min":1.135,"5min":1.0309999999999999,"15min":0.88100000000000001},"max":{"1min":5.0039999999999996,"5min":12.064,"15min":66.763999999999996},"last":1.4279999999999999},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4510000000000001,"15min":2.5659999999999998},"min":{"1min":1.365,"5min":1.2170000000000001,"15min":1.04},"max":{"1min":4.2919999999999998,"5min":7.9100000000000001,"15min":65.933999999999997},"last":1.7909999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":2.4990000000000001,"15min":2.25},"min":{"1min":1.2669999999999999,"5min":0.96799999999999997,"15min":0.94499999999999995},"max":{"1min":5.0759999999999996,"5min":11.321999999999999,"15min":11.321999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":2.2589999999999999,"5min":2.5449999999999999,"15min":2.403},"min":{"1min":1.4339999999999999,"5min":1.153,"15min":0.91100000000000003},"max":{"1min":4.1349999999999998,"5min":7.2210000000000001,"15min":7.2210000000000001},"last":1.8640000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":2.6989999999999998,"15min":2.5859999999999999},"min":{"1min":1.1850000000000001,"5min":1.1659999999999999,"15min":0.95899999999999996},"max":{"1min":6.5510000000000002,"5min":7.782,"15min":66.094999999999999},"last":1.766},{"interface":"front","average":{"1min":2.5640000000000001,"5min":2.4769999999999999,"15min":2.5619999999999998},"min":{"1min":1.325,"5min":1.133,"15min":1.014},"max":{"1min":6.367,"5min":11.57,"15min":66.566000000000003},"last":1.6779999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411647,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350116,"kb_used_data":64604,"kb_used_omap":0,"kb_used_meta":285504,"kb_avail":94021724,"statfs":{"total":96636764160,"available":96278245376,"internally_reserved":0,"allocated":66154496,"data_stored":65978896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":292356096},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.145,"15min":1.175},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.637,"5min":5.056,"15min":13.025},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2649999999999999,"15min":1.2090000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9199999999999999,"5min":8.9220000000000006,"15min":12.997},"last":1.3440000000000001}]},{"osd":3,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.53,"15min":1.357},"min":{"1min":0.61199999999999999,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":6.7960000000000003,"5min":6.7960000000000003,"15min":13.821999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.4470000000000001,"15min":1.4710000000000001},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":6.2030000000000003,"5min":6.2030000000000003,"15min":13.683999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6559999999999999,"15min":1.4710000000000001},"min":{"1min":0.72399999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"max":{"1min":6.4850000000000003,"5min":8.2059999999999995,"15min":14.170999999999999},"last":1.395},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.579,"15min":1.6479999999999999},"min":{"1min":0.94399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.8149999999999999,"5min":8.2379999999999995,"15min":14.146000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.675,"15min":1.5780000000000001},"min":{"1min":0.77100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.4829999999999997,"5min":8.7929999999999993,"15min":13.715999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.83399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":6.6699999999999999,"5min":6.6699999999999999,"15min":14.430999999999999},"last":1.157}]},{"osd":6,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.7530000000000001,"5min":3.0369999999999999,"15min":2.2370000000000001},"min":{"1min":1.05,"5min":0.85799999999999998,"15min":0.65400000000000003},"max":{"1min":12.843,"5min":28.844000000000001,"15min":28.844000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.8410000000000002,"15min":2.0939999999999999},"min":{"1min":1.0229999999999999,"5min":0.80800000000000005,"15min":0.70699999999999996},"max":{"1min":12.247999999999999,"5min":29.361000000000001,"15min":29.361000000000001},"last":1.5049999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.7210000000000001,"15min":1.8300000000000001},"min":{"1min":1.03,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":4.1319999999999997,"5min":5.7720000000000002,"15min":14.004},"last":1.377},{"interface":"front","average":{"1min":1.734,"5min":1.923,"15min":1.8220000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":4.2699999999999996,"5min":10.292999999999999,"15min":13.478},"last":1.542}]},{"osd":8,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.9410000000000001,"15min":1.909},"min":{"1min":1.089,"5min":1.089,"15min":0.94799999999999995},"max":{"1min":3.7189999999999999,"5min":5.9109999999999996,"15min":13.861000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":2.0219999999999998,"5min":2.0790000000000002,"15min":2.0150000000000001},"min":{"1min":1.0129999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":4.1630000000000003,"5min":9.5169999999999995,"15min":13.359},"last":1.452}]},{"osd":9,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.4239999999999999,"5min":2.4990000000000001,"15min":2.1549999999999998},"min":{"1min":1.1220000000000001,"5min":1.046,"15min":1.0429999999999999},"max":{"1min":6.5990000000000002,"5min":28.672999999999998,"15min":28.672999999999998},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.841,"5min":1.96,"15min":2.0630000000000002},"min":{"1min":1.2090000000000001,"5min":1.091,"15min":1.091},"max":{"1min":4.0629999999999997,"5min":5.726,"15min":14.271000000000001},"last":1.5669999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.1240000000000001,"15min":1.9359999999999999},"min":{"1min":1.2629999999999999,"5min":1.1140000000000001,"15min":1.0289999999999999},"max":{"1min":4.3739999999999997,"5min":10.159000000000001,"15min":13.597},"last":1.635},{"interface":"front","average":{"1min":2.1520000000000001,"5min":2.1030000000000002,"15min":1.996},"min":{"1min":1.226,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":6.7350000000000003,"5min":6.7569999999999997,"15min":14.555},"last":1.6970000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:37 2020","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":2.194,"15min":2.1709999999999998},"min":{"1min":1.161,"5min":1.161,"15min":1.1579999999999999},"max":{"1min":4.5179999999999998,"5min":5.7370000000000001,"15min":14.396000000000001},"last":1.659},{"interface":"front","average":{"1min":2.2000000000000002,"5min":2.2770000000000001,"15min":2.04},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.9980000000000002,"5min":9.4000000000000004,"15min":13.894},"last":1.7250000000000001}]}]},{"osd":0,"up_from":18,"seq":77309411647,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301296,"kb_used_data":37160,"kb_used_omap":0,"kb_used_meta":264128,"kb_avail":94070544,"statfs":{"total":96636764160,"available":96328237056,"internally_reserved":0,"allocated":38051840,"data_stored":37887017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270467072},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":1.677,"15min":1.401},"min":{"1min":0.65900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":5.7969999999999997,"5min":12.207000000000001,"15min":12.207000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.554,"15min":1.4019999999999999},"min":{"1min":0.67800000000000005,"5min":0.625,"15min":0.57099999999999995},"max":{"1min":6.2960000000000003,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.4930000000000001,"15min":1.4590000000000001},"min":{"1min":0.625,"5min":0.61699999999999999,"15min":0.59999999999999998},"max":{"1min":4.0940000000000003,"5min":5.7990000000000004,"15min":19.777999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.573,"5min":1.7869999999999999,"15min":1.6220000000000001},"min":{"1min":0.81100000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":6.4240000000000004,"5min":8.1519999999999992,"15min":8.1519999999999992},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":2.48,"15min":2.1720000000000002},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.627},"max":{"1min":6.2309999999999999,"5min":12.323,"15min":28.312000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.837,"5min":1.5640000000000001,"15min":1.726},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.57499999999999996},"max":{"1min":4.5339999999999998,"5min":5.1150000000000002,"15min":19.666},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":1.784,"5min":2.1019999999999999,"15min":1.8600000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":7.1040000000000001,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.88500000000000001},{"interface":"front","average":{"1min":2.0369999999999999,"5min":2.29,"15min":2.0419999999999998},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":6.3710000000000004,"5min":15.186999999999999,"15min":19.378},"last":1.034}]},{"osd":5,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":2.4289999999999998,"15min":2.258},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.73499999999999999},"max":{"1min":6.5949999999999998,"5min":14.744999999999999,"15min":19.501000000000001},"last":1.113},{"interface":"front","average":{"1min":2.1269999999999998,"5min":2.0409999999999999,"15min":2.0110000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84399999999999997},"max":{"1min":9.2159999999999993,"5min":9.2159999999999993,"15min":19.905000000000001},"last":1.214}]},{"osd":6,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":2.629,"15min":2.411},"min":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.75900000000000001},"max":{"1min":4.5209999999999999,"5min":10.334,"15min":21.288},"last":1.073},{"interface":"front","average":{"1min":2.3069999999999999,"5min":3.4569999999999999,"15min":2.8050000000000002},"min":{"1min":1.1100000000000001,"5min":1.0960000000000001,"15min":0.82199999999999995},"max":{"1min":7.1879999999999997,"5min":41.530999999999999,"15min":41.530999999999999},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":2.5289999999999999,"15min":2.3559999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":6.4850000000000003,"5min":12.43,"15min":21.946000000000002},"last":1.179},{"interface":"front","average":{"1min":2.282,"5min":2.2229999999999999,"15min":2.1829999999999998},"min":{"1min":1.222,"5min":1.1180000000000001,"15min":0.879},"max":{"1min":4.4749999999999996,"5min":6.0739999999999998,"15min":21.530000000000001},"last":1.3720000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":2.3620000000000001,"15min":2.3599999999999999},"min":{"1min":1.2410000000000001,"5min":1.018,"15min":1.018},"max":{"1min":7.2649999999999997,"5min":11.76,"15min":19.030999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":2.3220000000000001,"5min":2.6190000000000002,"15min":2.5459999999999998},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":6.8310000000000004,"5min":12.532,"15min":19.600999999999999},"last":1.2569999999999999}]},{"osd":10,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.371,"5min":2.839,"15min":2.6339999999999999},"min":{"1min":1.204,"5min":1.204,"15min":1.204},"max":{"1min":6.7160000000000002,"5min":15.432,"15min":19.678999999999998},"last":1.339},{"interface":"front","average":{"1min":2.5,"5min":2.4159999999999999,"15min":2.3439999999999999},"min":{"1min":1.3620000000000001,"5min":1.1879999999999999,"15min":0.995},"max":{"1min":6.3550000000000004,"5min":6.3550000000000004,"15min":21.41},"last":1.52}]},{"osd":11,"last update":"Fri Nov 20 11:43:38 2020","interfaces":[{"interface":"back","average":{"1min":2.1549999999999998,"5min":2.5670000000000002,"15min":2.3959999999999999},"min":{"1min":1.3089999999999999,"5min":1.1519999999999999,"15min":1.131},"max":{"1min":7.3559999999999999,"5min":8.3979999999999997,"15min":19.155999999999999},"last":1.246},{"interface":"front","average":{"1min":2.605,"5min":2.9209999999999998,"15min":2.6789999999999998},"min":{"1min":1.264,"5min":1.264,"15min":1.26},"max":{"1min":7.0090000000000003,"5min":12.634,"15min":19.818000000000001},"last":1.429}]}]},{"osd":3,"up_from":18,"seq":77309411647,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":626964,"kb_used_data":107788,"kb_used_omap":0,"kb_used_meta":519168,"kb_avail":93744876,"statfs":{"total":96636764160,"available":95994753024,"internally_reserved":0,"allocated":110374912,"data_stored":110193384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":531628032},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.6970000000000001,"15min":1.5049999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.4660000000000002,"5min":8.9789999999999992,"15min":9.4689999999999994},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.6879999999999999,"15min":1.4730000000000001},"min":{"1min":0.69599999999999995,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":3.3479999999999999,"5min":4.6260000000000003,"15min":8.6880000000000006},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.6479999999999999,"15min":1.486},"min":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2989999999999999,"5min":8.4220000000000006,"15min":8.4220000000000006},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.613,"5min":1.7390000000000001,"15min":1.593},"min":{"1min":0.89800000000000002,"5min":0.745,"15min":0.58699999999999997},"max":{"1min":2.6040000000000001,"5min":4.7430000000000003,"15min":6.7709999999999999},"last":1.3420000000000001}]},{"osd":4,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.6519999999999999,"15min":1.4830000000000001},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3180000000000001,"5min":6.1879999999999997,"15min":6.1879999999999997},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.9079999999999999,"15min":1.6639999999999999},"min":{"1min":0.94099999999999995,"5min":0.69799999999999995,"15min":0.67200000000000004},"max":{"1min":4.702,"5min":6.9850000000000003,"15min":6.9850000000000003},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":2.0139999999999998,"15min":1.841},"min":{"1min":1.0009999999999999,"5min":0.81899999999999995,"15min":0.69999999999999996},"max":{"1min":3.238,"5min":7.1509999999999998,"15min":23.041},"last":1.206},{"interface":"front","average":{"1min":1.427,"5min":1.9570000000000001,"15min":1.8380000000000001},"min":{"1min":0.80800000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.407,"5min":6.9619999999999997,"15min":22.581},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.5779999999999998,"5min":2.96,"15min":2.5510000000000002},"min":{"1min":1.04,"5min":0.84699999999999998,"15min":0.69699999999999995},"max":{"1min":18.344999999999999,"5min":23.417000000000002,"15min":67.936999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.7639999999999998,"15min":2.218},"min":{"1min":1.0669999999999999,"5min":0.86099999999999999,"15min":0.82999999999999996},"max":{"1min":17.199000000000002,"5min":19.280999999999999,"15min":19.280999999999999},"last":1.002}]},{"osd":7,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.879,"5min":2.246,"15min":1.8939999999999999},"min":{"1min":1.3109999999999999,"5min":1.089,"15min":0.84899999999999998},"max":{"1min":3.056,"5min":7.8310000000000004,"15min":7.8310000000000004},"last":1.456},{"interface":"front","average":{"1min":1.8220000000000001,"5min":2.3290000000000002,"15min":2.0499999999999998},"min":{"1min":1.0860000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.7130000000000001,"5min":10.206,"15min":10.206},"last":1.194}]},{"osd":8,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":2.2109999999999999,"15min":2.0249999999999999},"min":{"1min":1.141,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.0379999999999998,"5min":8.7629999999999999,"15min":10.893000000000001},"last":1.173},{"interface":"front","average":{"1min":2.1160000000000001,"5min":2.2029999999999998,"15min":2.0550000000000002},"min":{"1min":1.4239999999999999,"5min":1.216,"15min":1.02},"max":{"1min":3.4209999999999998,"5min":4.5060000000000002,"15min":10.787000000000001},"last":1.522}]},{"osd":9,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.5499999999999998,"15min":2.3100000000000001},"min":{"1min":1.3540000000000001,"5min":1.157,"15min":1.081},"max":{"1min":3.556,"5min":6.8920000000000003,"15min":9.0779999999999994},"last":1.056},{"interface":"front","average":{"1min":1.927,"5min":2.444,"15min":2.2320000000000002},"min":{"1min":1.3109999999999999,"5min":1.083,"15min":1.083},"max":{"1min":3.2639999999999998,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.413}]},{"osd":10,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":2.4860000000000002,"15min":2.23},"min":{"1min":1.2470000000000001,"5min":1.1499999999999999,"15min":1.1000000000000001},"max":{"1min":3.149,"5min":8.875,"15min":8.875},"last":1.294},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.3650000000000002,"15min":2.085},"min":{"1min":1.2609999999999999,"5min":1.1899999999999999,"15min":1.0569999999999999},"max":{"1min":4.4770000000000003,"5min":7.7089999999999996,"15min":7.7089999999999996},"last":1.585}]},{"osd":11,"last update":"Fri Nov 20 11:43:19 2020","interfaces":[{"interface":"back","average":{"1min":2.181,"5min":2.488,"15min":2.2410000000000001},"min":{"1min":1.4379999999999999,"5min":1.2969999999999999,"15min":1.0860000000000001},"max":{"1min":3.4849999999999999,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.4260000000000002,"15min":2.2749999999999999},"min":{"1min":1.4690000000000001,"5min":1.1479999999999999,"15min":1.1459999999999999},"max":{"1min":2.7290000000000001,"5min":6.7889999999999997,"15min":10.993},"last":1.2589999999999999}]}]},{"osd":4,"up_from":18,"seq":77309411648,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353780,"kb_used_data":74028,"kb_used_omap":0,"kb_used_meta":279744,"kb_avail":94018060,"statfs":{"total":96636764160,"available":96274493440,"internally_reserved":0,"allocated":75804672,"data_stored":75635787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":286457856},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.101,"15min":1.081},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54400000000000004},"max":{"1min":3.3500000000000001,"5min":4.0090000000000003,"15min":4.7480000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7569999999999997,"5min":5.734,"15min":10.750999999999999},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.139,"15min":1.171},"min":{"1min":0.63700000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.5800000000000001,"5min":4.1749999999999998,"15min":5.4240000000000004},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.3009999999999999,"15min":1.3600000000000001},"min":{"1min":0.75,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.518,"5min":5.4379999999999997,"15min":6.8659999999999997},"last":1.228}]},{"osd":3,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.5620000000000001,"15min":1.3280000000000001},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.0039999999999996,"5min":28.899999999999999,"15min":28.899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.746,"5min":1.9279999999999999,"15min":1.6279999999999999},"min":{"1min":0.80100000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.173,"5min":28.882000000000001,"15min":28.882000000000001},"last":1.075}]},{"osd":5,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.4470000000000001,"15min":1.343},"min":{"1min":0.65500000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.8439999999999999,"5min":6.1589999999999998,"15min":6.1760000000000002},"last":1.145},{"interface":"front","average":{"1min":1.631,"5min":1.3240000000000001,"15min":1.2949999999999999},"min":{"1min":0.78600000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":6.5129999999999999,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":2.0030000000000001,"15min":1.6200000000000001},"min":{"1min":0.86899999999999999,"5min":0.73099999999999998,"15min":0.67800000000000005},"max":{"1min":2.621,"5min":18.018000000000001,"15min":18.018000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":2.2570000000000001,"15min":1.835},"min":{"1min":0.874,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":4.3140000000000001,"5min":18.004000000000001,"15min":18.004000000000001},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5,"15min":1.5309999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.6309999999999998,"5min":6.2300000000000004,"15min":6.7400000000000002},"last":1.04},{"interface":"front","average":{"1min":1.782,"5min":1.528,"15min":1.4890000000000001},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":6.2809999999999997,"5min":6.2809999999999997,"15min":7.6699999999999999},"last":1.1100000000000001}]},{"osd":8,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.5640000000000001,"15min":1.603},"min":{"1min":0.89100000000000001,"5min":0.79800000000000004,"15min":0.76100000000000001},"max":{"1min":4.319,"5min":4.319,"15min":6.2560000000000002},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.7210000000000001,"15min":1.7589999999999999},"min":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.532,"5min":6.3710000000000004,"15min":10.625999999999999},"last":1.4379999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":1.7749999999999999,"15min":1.7589999999999999},"min":{"1min":1.0269999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":6.4480000000000004},"last":1.409},{"interface":"front","average":{"1min":1.593,"5min":1.8620000000000001,"15min":1.8779999999999999},"min":{"1min":1.0620000000000001,"5min":0.99399999999999999,"15min":0.90800000000000003},"max":{"1min":2.806,"5min":6.5449999999999999,"15min":6.6310000000000002},"last":1.319}]},{"osd":10,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.6499999999999999,"15min":1.651},"min":{"1min":1.1240000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.9099999999999999,"5min":1.8180000000000001,"15min":1.796},"min":{"1min":1.1539999999999999,"5min":1.0860000000000001,"15min":1.0349999999999999},"max":{"1min":4.8170000000000002,"5min":7.9329999999999998,"15min":7.9329999999999998},"last":1.821}]},{"osd":11,"last update":"Fri Nov 20 11:43:30 2020","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.8300000000000001,"15min":1.845},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.9279999999999999,"5min":6.4829999999999997,"15min":6.6210000000000004},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.794,"5min":1.694,"15min":1.675},"min":{"1min":1.1399999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":6.4009999999999998,"5min":6.4009999999999998,"15min":6.4009999999999998},"last":1.4710000000000001}]}]},{"osd":5,"up_from":18,"seq":77309411648,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458500,"kb_used_data":38140,"kb_used_omap":0,"kb_used_meta":420352,"kb_avail":93913340,"statfs":{"total":96636764160,"available":96167260160,"internally_reserved":0,"allocated":39055360,"data_stored":38889481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":430440448},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.268,"15min":1.861},"min":{"1min":0.61899999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.2300000000000004,"5min":12.923,"15min":173.643},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3520000000000001,"15min":2.0670000000000002},"min":{"1min":0.64800000000000002,"5min":0.63,"15min":0.56299999999999994},"max":{"1min":5.6470000000000002,"5min":10.327999999999999,"15min":173.71899999999999},"last":1.6160000000000001}]},{"osd":1,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4159999999999999,"15min":1.3},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.51800000000000002},"max":{"1min":3.113,"5min":13.898999999999999,"15min":13.898999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.4990000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59099999999999997},"max":{"1min":4.3680000000000003,"5min":10.234,"15min":10.234},"last":1.153}]},{"osd":2,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.66200000000000003,"5min":0.57899999999999996,"15min":0.54500000000000004},"max":{"1min":5.7720000000000002,"5min":8.2780000000000005,"15min":8.2780000000000005},"last":1.177},{"interface":"front","average":{"1min":1.484,"5min":1.5149999999999999,"15min":1.3580000000000001},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.55800000000000005},"max":{"1min":4.1920000000000002,"5min":10.614000000000001,"15min":10.614000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4690000000000001,"15min":1.454},"min":{"1min":0.95599999999999996,"5min":0.623,"15min":0.623},"max":{"1min":3.3610000000000002,"5min":10.728,"15min":10.728},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.532,"15min":1.544},"min":{"1min":0.83499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.8899999999999997,"5min":10.449999999999999,"15min":10.449999999999999},"last":1.3440000000000001}]},{"osd":6,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.1379999999999999,"15min":1.821},"min":{"1min":1.1000000000000001,"5min":0.93300000000000005,"15min":0.70999999999999996},"max":{"1min":7.7080000000000002,"5min":13.782,"15min":13.782},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.8680000000000001,"5min":2.3730000000000002,"15min":1.9850000000000001},"min":{"1min":0.98699999999999999,"5min":0.89200000000000002,"15min":0.64900000000000002},"max":{"1min":7.633,"5min":20.225999999999999,"15min":20.225999999999999},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.8169999999999999,"15min":1.786},"min":{"1min":1.04,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":6.3090000000000002,"5min":10.957000000000001,"15min":11.082000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.97,"5min":1.8899999999999999,"15min":1.8520000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.0329999999999999},"max":{"1min":6.0199999999999996,"5min":11.054,"15min":11.054},"last":1.212}]},{"osd":8,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":2.0960000000000001,"15min":1.972},"min":{"1min":1.224,"5min":1.089,"15min":1.0449999999999999},"max":{"1min":5.1589999999999998,"5min":18.199000000000002,"15min":18.199000000000002},"last":1.294},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.895,"15min":1.7350000000000001},"min":{"1min":0.99199999999999999,"5min":0.95699999999999996,"15min":0.76000000000000001},"max":{"1min":5.2149999999999999,"5min":13.041,"15min":13.041},"last":1.4119999999999999}]},{"osd":9,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.3359999999999999,"15min":1.994},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":0.86099999999999999},"max":{"1min":11.369,"5min":13.15,"15min":13.15},"last":1.24},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1259999999999999,"15min":2.0030000000000001},"min":{"1min":1.256,"5min":1.1890000000000001,"15min":0.92000000000000004},"max":{"1min":6.6820000000000004,"5min":10.837,"15min":10.837},"last":2.0550000000000002}]},{"osd":10,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.99,"15min":1.988},"min":{"1min":1.1699999999999999,"5min":1.139,"15min":1.071},"max":{"1min":6.1820000000000004,"5min":16.297999999999998,"15min":16.297999999999998},"last":2.1930000000000001},{"interface":"front","average":{"1min":2.1200000000000001,"5min":2.016,"15min":2.0129999999999999},"min":{"1min":1.323,"5min":1.2410000000000001,"15min":1.24},"max":{"1min":5.0780000000000003,"5min":10.949999999999999,"15min":10.949999999999999},"last":1.4590000000000001}]},{"osd":11,"last update":"Fri Nov 20 11:43:27 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":2.3780000000000001,"15min":2.073},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":0.96599999999999997},"max":{"1min":11.234999999999999,"5min":13.420999999999999,"15min":13.420999999999999},"last":1.329},{"interface":"front","average":{"1min":1.974,"5min":2.516,"15min":2.282},"min":{"1min":1.417,"5min":1.2949999999999999,"15min":1.101},"max":{"1min":4.2599999999999998,"5min":19.321999999999999,"15min":19.321999999999999},"last":1.54}]}]},{"osd":6,"up_from":18,"seq":77309411647,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":499108,"kb_used_data":85084,"kb_used_omap":0,"kb_used_meta":414016,"kb_avail":93872732,"statfs":{"total":96636764160,"available":96125677568,"internally_reserved":0,"allocated":87126016,"data_stored":86950416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":423952384},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 11:43:59 2020","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":1.6859999999999999,"15min":1.569},"min":{"1min":0.67100000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5649999999999999,"5min":12.869999999999999,"15min":12.869999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":2.0459999999999998,"15min":1.653},"min":{"1min":0.66200000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":5.7199999999999998,"5min":19.547999999999998,"15min":19.547999999999998},"last":0.624}]},{"osd":1,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.1070000000000002,"15min":1.675},"min":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.55400000000000005},"max":{"1min":5.3259999999999996,"5min":27.954999999999998,"15min":27.954999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.496,"5min":2.2010000000000001,"15min":1.806},"min":{"1min":0.89100000000000001,"5min":0.73499999999999999,"15min":0.57099999999999995},"max":{"1min":3.597,"5min":16.134,"15min":16.134},"last":0.94899999999999995}]},{"osd":2,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.9419999999999999,"15min":1.6699999999999999},"min":{"1min":0.84499999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":5.8499999999999996,"5min":15.946,"15min":15.946},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.6020000000000001,"5min":2.2709999999999999,"15min":1.8740000000000001},"min":{"1min":0.77800000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":5.5259999999999998,"5min":28.532,"15min":28.532},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":2.77,"15min":2.5129999999999999},"min":{"1min":0.99199999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":6.1920000000000002,"5min":19.510999999999999,"15min":96.781999999999996},"last":0.752},{"interface":"front","average":{"1min":1.907,"5min":2.6429999999999998,"15min":2.4980000000000002},"min":{"1min":0.876,"5min":0.76400000000000001,"15min":0.69299999999999995},"max":{"1min":6.5960000000000001,"5min":16.683,"15min":96.558999999999997},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Nov 20 11:43:59 2020","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":2.8380000000000001,"15min":2.2589999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79600000000000004},"max":{"1min":5.117,"5min":28.484999999999999,"15min":28.484999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":2.3610000000000002,"15min":2.0979999999999999},"min":{"1min":1.0629999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.96,"5min":16.672000000000001,"15min":16.672000000000001},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":2.9830000000000001,"15min":2.4220000000000002},"min":{"1min":0.95799999999999996,"5min":0.879,"15min":0.85399999999999998},"max":{"1min":5.7919999999999998,"5min":28.622,"15min":28.622},"last":1.327},{"interface":"front","average":{"1min":1.9490000000000001,"5min":2.7549999999999999,"15min":2.2690000000000001},"min":{"1min":1.179,"5min":0.88700000000000001,"15min":0.83799999999999997},"max":{"1min":6.3360000000000003,"5min":19.669,"15min":19.669},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2599999999999998,"5min":3.218,"15min":2.5139999999999998},"min":{"1min":1.091,"5min":1.089,"15min":1.03},"max":{"1min":6.032,"5min":30.012,"15min":30.012},"last":1.1919999999999999},{"interface":"front","average":{"1min":2.0190000000000001,"5min":2.7749999999999999,"15min":2.3109999999999999},"min":{"1min":1.1639999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":6.4640000000000004,"5min":16.712,"15min":16.712},"last":1.1719999999999999}]},{"osd":8,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.3340000000000001,"5min":3.4199999999999999,"15min":2.6389999999999998},"min":{"1min":1.3320000000000001,"5min":1.2210000000000001,"15min":0.97299999999999998},"max":{"1min":5.9109999999999996,"5min":28.960000000000001,"15min":28.960000000000001},"last":1.47},{"interface":"front","average":{"1min":2.0680000000000001,"5min":3.097,"15min":2.4590000000000001},"min":{"1min":1.321,"5min":1.04,"15min":1.04},"max":{"1min":6.5830000000000002,"5min":19.800000000000001,"15min":19.800000000000001},"last":1.248}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":10,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":1.9390000000000001,"5min":2.7480000000000002,"15min":2.3140000000000001},"min":{"1min":1.198,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":6.1909999999999998,"5min":16.420000000000002,"15min":16.420000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":2.5310000000000001,"5min":3.496,"15min":2.7789999999999999},"min":{"1min":1.3280000000000001,"5min":1.2070000000000001,"15min":1.1020000000000001},"max":{"1min":6.1550000000000002,"5min":28.882999999999999,"15min":28.882999999999999},"last":1.613}]},{"osd":11,"last update":"Fri Nov 20 11:43:51 2020","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":3.444,"15min":2.6709999999999998},"min":{"1min":1.4159999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":6.6779999999999999,"5min":19.920999999999999,"15min":19.920999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.8919999999999999,"15min":2.4409999999999998},"min":{"1min":1.2889999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":6.0720000000000001,"5min":16.553000000000001,"15min":16.553000000000001},"last":1.113}]}]}]}} 2020-11-20T11:44:22.433 INFO:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T11:44:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.542+0000 7f5280699700 1 Processor -- start 2020-11-20T11:44:22.568 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.542+0000 7f5280699700 1 -- start start 2020-11-20T11:44:22.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f5280699700 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5278065d30 0x7f5278066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.569 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f5280699700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f52780bfa50 0x7f52780c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f5280699700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52780c5230 con 0x7f52780c4c60 2020-11-20T11:44:22.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f5280699700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52781549c0 con 0x7f52780bfa50 2020-11-20T11:44:22.570 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f5280699700 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5278154c60 con 0x7f5278065d30 2020-11-20T11:44:22.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f527ec36700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f52780c4c60 0x7f52781512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35992/0 (socket says 172.21.15.112:35992) 2020-11-20T11:44:22.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.543+0000 7f527ec36700 1 -- 172.21.15.112:0/3556624888 learned_addr learned my addr 172.21.15.112:0/3556624888 (peer_addr_for_me v1:172.21.15.112:0/0) 2020-11-20T11:44:22.571 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 --2- 172.21.15.112:0/3556624888 >> v2:172.21.15.166:3300/0 conn(0x7f52780bfa50 0x7f52780c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.572 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527e435700 1 --2- 172.21.15.112:0/3556624888 >> v2:172.21.15.204:3300/0 conn(0x7f5278065d30 0x7f5278066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.572 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527713225 0 0) 0x7f52780c5230 con 0x7f52780c4c60 2020-11-20T11:44:22.572 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5260003280 con 0x7f52780c4c60 2020-11-20T11:44:22.573 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 -- 172.21.15.112:0/3556624888 >> v2:172.21.15.204:3300/0 conn(0x7f5278065d30 msgr2=0x7f5278066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:44:22.573 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 --2- 172.21.15.112:0/3556624888 >> v2:172.21.15.204:3300/0 conn(0x7f5278065d30 0x7f5278066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.573 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 -- 172.21.15.112:0/3556624888 >> v1:172.21.15.112:6789/0 conn(0x7f52780c4c60 legacy=0x7f52781512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.574 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2550634734 0 0) 0x7f5260003280 con 0x7f52780c4c60 2020-11-20T11:44:22.574 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 -- 172.21.15.112:0/3556624888 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278154f00 con 0x7f52780bfa50 2020-11-20T11:44:22.574 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527dc34700 1 --2- 172.21.15.112:0/3556624888 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f52780bfa50 0x7f52780c4770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f52780c79a0 tx=0x7f526c006e30).ready entity=mon.1 client_cookie=871a47f1806d406 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700018a0 con 0x7f52780bfa50 2020-11-20T11:44:22.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c000e90 con 0x7f52780bfa50 2020-11-20T11:44:22.575 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.544+0000 7f527d433700 1 -- 172.21.15.112:0/3556624888 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011610 con 0x7f52780bfa50 2020-11-20T11:44:22.578 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 -- 172.21.15.112:0/3556624888 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f52780bfa50 msgr2=0x7f52780c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.579 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 --2- 172.21.15.112:0/3556624888 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f52780bfa50 0x7f52780c4770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f52780c79a0 tx=0x7f526c006e30).stop 2020-11-20T11:44:22.580 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 -- 172.21.15.112:0/3556624888 shutdown_connections 2020-11-20T11:44:22.581 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 --2- 172.21.15.112:0/3556624888 >> v2:172.21.15.204:3300/0 conn(0x7f5278065d30 0x7f5278066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.582 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 --2- 172.21.15.112:0/3556624888 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f52780bfa50 0x7f52780c4770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.583 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 -- 172.21.15.112:0/3556624888 >> 172.21.15.112:0/3556624888 conn(0x7f527805bac0 msgr2=0x7f527805bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 -- 172.21.15.112:0/3556624888 shutdown_connections 2020-11-20T11:44:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.545+0000 7f5280699700 1 -- 172.21.15.112:0/3556624888 wait complete. 2020-11-20T11:44:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.546+0000 7f5280699700 1 Processor -- start 2020-11-20T11:44:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.546+0000 7f5280699700 1 -- start start 2020-11-20T11:44:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5278065d30 0x7f52781606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52780c4c60 0x7f52780c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780c64a0 con 0x7f52780bfa50 2020-11-20T11:44:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780c6740 con 0x7f5278065d30 2020-11-20T11:44:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780c69e0 con 0x7f52780c4c60 2020-11-20T11:44:22.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51804/0 (socket says 172.21.15.112:51804) 2020-11-20T11:44:22.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 -- 172.21.15.112:0/2642878401 learned_addr learned my addr 172.21.15.112:0/2642878401 (peer_addr_for_me v2:172.21.15.112:0/0) 2020-11-20T11:44:22.588 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527e435700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5278065d30 0x7f52781606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527ec36700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52780c4c60 0x7f52780c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 -- 172.21.15.112:0/2642878401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52780c4c60 msgr2=0x7f52780c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52780c4c60 0x7f52780c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 -- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5278065d30 msgr2=0x7f52781606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.589 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5278065d30 0x7f52781606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 -- 172.21.15.112:0/2642878401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780c6c80 con 0x7f52780bfa50 2020-11-20T11:44:22.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f527dc34700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f527805d740 tx=0x7f526c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c010b10 con 0x7f52780bfa50 2020-11-20T11:44:22.590 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c010c70 con 0x7f52780bfa50 2020-11-20T11:44:22.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52780c6f20 con 0x7f52780bfa50 2020-11-20T11:44:22.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c01d3c0 con 0x7f52780bfa50 2020-11-20T11:44:22.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.547+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52780c7660 con 0x7f52780bfa50 2020-11-20T11:44:22.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.548+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52780c7380 con 0x7f52780bfa50 2020-11-20T11:44:22.591 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.549+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f526c01a040 con 0x7f52780bfa50 2020-11-20T11:44:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.549+0000 7f526a7fc700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 0x7f5250082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:44:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.550+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f526c0a3a00 con 0x7f52780bfa50 2020-11-20T11:44:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.550+0000 7f527e435700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 0x7f5250082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:44:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.550+0000 7f527e435700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 0x7f5250082b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f5274006fd0 tx=0x7f5274006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:44:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.553+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f526c078390 con 0x7f52780bfa50 2020-11-20T11:44:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.699+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f52780666e0 con 0x7f52780bfa50 2020-11-20T11:44:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.703+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f526c078390 con 0x7f52780bfa50 2020-11-20T11:44:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.703+0000 7f526a7fc700 1 -- 172.21.15.112:0/2642878401 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f526c07b9b0 con 0x7f52780bfa50 2020-11-20T11:44:22.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 msgr2=0x7f5250082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 0x7f5250082b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f5274006fd0 tx=0x7f5274006e30).stop 2020-11-20T11:44:22.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 msgr2=0x7f52780b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:44:22.709 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f527805d740 tx=0x7f526c015000).stop 2020-11-20T11:44:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 shutdown_connections 2020-11-20T11:44:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:6800/22614,v1:172.21.15.166:6801/22614] conn(0x7f5250080670 0x7f5250082b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52780c4c60 0x7f52780c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5278065d30 0x7f52781606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.710 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 --2- 172.21.15.112:0/2642878401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780bfa50 0x7f52780b0ee0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:44:22.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 >> 172.21.15.112:0/2642878401 conn(0x7f527805bac0 msgr2=0x7f527814fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:44:22.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 shutdown_connections 2020-11-20T11:44:22.711 INFO:teuthology.orchestra.run.smithi112.stderr:2020-11-20T11:44:22.705+0000 7f5280699700 1 -- 172.21.15.112:0/2642878401 wait complete. 2020-11-20T11:44:22.720 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T11:44:22.720 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T11:44:22.721 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:22.733 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T11:44:22.734 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T11:44:22.734 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:25.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-11-20T11:44:28.836 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T11:44:28.838 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-11-20T11:44:28.838 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:28.923 INFO:tasks.ceph.mds.c:Stopped 2020-11-20T11:44:28.924 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T11:44:28.925 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T11:44:28.925 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.000 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T11:44:29.001 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T11:44:29.002 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.058 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T11:44:29.059 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T11:44:29.059 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.149 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T11:44:29.149 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2020-11-20T11:44:29.150 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.216 INFO:tasks.ceph.osd.9:Stopped 2020-11-20T11:44:29.216 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T11:44:29.216 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.275 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T11:44:29.275 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T11:44:29.276 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.348 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T11:44:29.349 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T11:44:29.349 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.426 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T11:44:29.427 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2020-11-20T11:44:29.427 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.527 INFO:tasks.ceph.osd.10:Stopped 2020-11-20T11:44:29.527 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T11:44:29.528 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.599 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T11:44:29.600 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T11:44:29.600 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.693 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T11:44:29.694 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2020-11-20T11:44:29.694 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.755 INFO:tasks.ceph.osd.8:Stopped 2020-11-20T11:44:29.755 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2020-11-20T11:44:29.755 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.825 INFO:tasks.ceph.osd.11:Stopped 2020-11-20T11:44:29.825 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T11:44:29.826 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T11:44:29.826 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.842 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T11:44:29.843 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T11:44:29.843 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.861 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T11:44:29.861 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2020-11-20T11:44:29.862 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.880 INFO:tasks.ceph.mgr.z:Stopped 2020-11-20T11:44:29.880 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T11:44:29.880 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T11:44:29.881 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.895 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T11:44:29.895 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T11:44:29.896 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.911 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T11:44:29.912 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T11:44:29.912 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T11:44:29.930 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T11:44:29.930 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T11:44:29.931 INFO:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-11-20T11:44:29.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:44:29.995 INFO:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T11:44:30.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-11-20T11:44:30.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:44:30.945 INFO:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T11:44:31.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:44:31.160 INFO:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T11:44:31.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi112.front.sepia.ceph.com 2020-11-20T11:44:31.374 INFO:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2020-11-20T11:44:31.516 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:44:31.517 INFO:teuthology.orchestra.run.smithi166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T11:44:32.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:44:32.163 INFO:teuthology.orchestra.run.smithi166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T11:44:32.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:44:32.361 INFO:teuthology.orchestra.run.smithi166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T11:44:32.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-20T11:44:32.417 INFO:teuthology.orchestra.run.smithi166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2020-11-20T11:44:32.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:44:32.588 INFO:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T11:44:33.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:44:33.088 INFO:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T11:44:33.229 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:44:33.229 INFO:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2020-11-20T11:44:33.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi204.front.sepia.ceph.com 2020-11-20T11:44:33.303 INFO:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2020-11-20T11:44:33.389 INFO:tasks.ceph:Archiving mon data... 2020-11-20T11:44:33.399 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/data/mon.a.tgz 2020-11-20T11:44:33.400 INFO:teuthology.orchestra.run.smithi112:> mktemp 2020-11-20T11:44:33.477 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.LG1IifgmaU 2020-11-20T11:44:33.477 INFO:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LG1IifgmaU 2020-11-20T11:44:33.748 INFO:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.LG1IifgmaU 2020-11-20T11:44:33.972 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.LG1IifgmaU is 839KB 2020-11-20T11:44:34.066 INFO:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.LG1IifgmaU 2020-11-20T11:44:34.082 DEBUG:teuthology.misc:Transferring archived files from smithi166:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/data/mon.b.tgz 2020-11-20T11:44:34.082 INFO:teuthology.orchestra.run.smithi166:> mktemp 2020-11-20T11:44:34.116 INFO:teuthology.orchestra.run.smithi166.stdout:/tmp/tmp.g2gbPBCy18 2020-11-20T11:44:34.116 INFO:teuthology.orchestra.run.smithi166:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.g2gbPBCy18 2020-11-20T11:44:34.447 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 0666 /tmp/tmp.g2gbPBCy18 2020-11-20T11:44:34.575 DEBUG:teuthology.orchestra.remote:smithi166:/tmp/tmp.g2gbPBCy18 is 851KB 2020-11-20T11:44:34.691 INFO:teuthology.orchestra.run.smithi166:> rm -fr /tmp/tmp.g2gbPBCy18 2020-11-20T11:44:34.712 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/data/mon.c.tgz 2020-11-20T11:44:34.713 INFO:teuthology.orchestra.run.smithi204:> mktemp 2020-11-20T11:44:34.745 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.T2VKRPRG71 2020-11-20T11:44:34.747 INFO:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.T2VKRPRG71 2020-11-20T11:44:35.059 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.T2VKRPRG71 2020-11-20T11:44:35.174 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.T2VKRPRG71 is 851KB 2020-11-20T11:44:35.280 INFO:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.T2VKRPRG71 2020-11-20T11:44:35.294 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T11:44:35.294 INFO:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:44:35.297 INFO:teuthology.orchestra.run.smithi166:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:44:35.300 INFO:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T11:44:35.386 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T11:44:35.386 INFO:teuthology.orchestra.run.smithi112:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:44:35.388 INFO:teuthology.orchestra.run.smithi166:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:44:35.391 INFO:teuthology.orchestra.run.smithi204:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T11:44:35.412 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:44:35.416 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:44:35.419 INFO:teuthology.orchestra.run.smithi166.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T11:44:35.450 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T11:44:35.452 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/remote/smithi112/crash 2020-11-20T11:44:35.454 INFO:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:44:35.516 DEBUG:teuthology.misc:Transferring archived files from smithi166:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/remote/smithi166/crash 2020-11-20T11:44:35.518 INFO:teuthology.orchestra.run.smithi166:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:44:35.549 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/remote/smithi204/crash 2020-11-20T11:44:35.550 INFO:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T11:44:35.576 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T11:45:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:ceph-osd: no process found 2020-11-20T12:13:59.741 INFO:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:03.714 INFO:teuthology.orchestra.run.smithi166:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:03.854 INFO:teuthology.orchestra.run.smithi204:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:03.969 INFO:tasks.ceph:Compressing logs... 2020-11-20T12:14:03.970 INFO:teuthology.orchestra.run.smithi112:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:14:03.977 INFO:teuthology.orchestra.run.smithi166:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:14:03.985 INFO:teuthology.orchestra.run.smithi204:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:14:03.990 INFO:tasks.ceph:Archiving logs... 2020-11-20T12:14:03.995 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640209/remote/smithi112/log 2020-11-20T12:14:03.999 INFO:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/log/ceph -- . 2020-11-20T12:17:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-mon.a.log: File removed before we read it 2020-11-20T12:17:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.26826.log: File removed before we read it 2020-11-20T12:17:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph.tmp-client.admin.18382.log: File removed before we read it 2020-11-20T12:17:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.27834.log: File removed before we read it 2020-11-20T12:17:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.28002.log: File removed before we read it 2020-11-20T12:17:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.28503.log: File removed before we read it 2020-11-20T12:17:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.27582.log: File removed before we read it 2020-11-20T12:17:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.26868.log: File removed before we read it 2020-11-20T12:17:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.30848.log: File removed before we read it 2020-11-20T12:17:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.26700.log: File removed before we read it 2020-11-20T12:17:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.29965.log: File removed before we read it 2020-11-20T12:17:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.27414.log: File removed before we read it 2020-11-20T12:17:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.26994.log: File removed before we read it 2020-11-20T12:18:01.233 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.25804.log: File removed before we read it 2020-11-20T12:18:01.233 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.27162.log: File removed before we read it 2020-11-20T12:18:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.28044.log: File removed before we read it 2020-11-20T12:18:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:tar: ./ceph-client.admin.30898.log: File removed before we read it